-- Logs begin at Wed 2022-05-18 21:32:20 UTC, end at Wed 2022-05-18 23:06:10 UTC. -- May 18 22:21:50.204829 dv-cinder-838009-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 18 22:21:50.212028 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 22:21:50 2022] *** May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: nodename: dv-cinder-838009-6-iscsi May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: machine: x86_64 May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: clock source: unix May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: pcre jit disabled May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: detected number of CPU cores: 4 May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: current working directory: / May 18 22:21:50.215050 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: detected binary path: /usr/bin/uwsgi-core May 18 22:21:50.215621 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: your processes number limit is 47680 May 18 22:21:50.215621 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: your memory page size is 4096 bytes May 18 22:21:50.215621 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: detected max file descriptor number: 2048 May 18 22:21:50.215621 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: lock engine: pthread robust mutexes May 18 22:21:50.215621 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: thunder lock: enabled May 18 22:21:50.215621 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 18 22:21:50.215621 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 22:21:50.260898 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: Python main interpreter initialized at 0x5621a04929c0 May 18 22:21:50.260898 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: python threads support enabled May 18 22:21:50.260898 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: your server socket listen backlog is limited to 100 connections May 18 22:21:50.260898 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: your mercy for graceful operations on workers is 90 seconds May 18 22:21:50.261272 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: mapped 403077 bytes (393 KB) for 2 cores May 18 22:21:50.261344 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: *** Operational MODE: preforking *** May 18 22:21:50.261583 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: *** uWSGI is running in multiple interpreter mode *** May 18 22:21:50.261583 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: spawned uWSGI master process (pid: 80351) May 18 22:21:50.261788 dv-cinder-838009-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 18 22:21:50.263734 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: spawned uWSGI worker 1 (pid: 80363, cores: 1) May 18 22:21:50.263734 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: spawned uWSGI worker 2 (pid: 80364, cores: 1) May 18 22:21:50.263734 dv-cinder-838009-6-iscsi devstack@keystone.service[80351]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 22:21:55.958313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:21:55.958313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: from cryptography.utils import int_from_bytes May 18 22:21:55.959140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:21:55.959140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: from cryptography.utils import int_from_bytes May 18 22:21:55.984399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:21:55.984399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: from cryptography.utils import int_from_bytes May 18 22:21:55.984921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:21:55.984921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: from cryptography.utils import int_from_bytes May 18 22:21:56.008482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 22:21:56.008676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 22:21:56.008869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] command line args: [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 22:21:56.009141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 22:21:56.009859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ================================================================================ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 22:21:56.010287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] admin_token = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.010730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] config_dir = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.011078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.011396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] config_source = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.011718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] debug = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.012049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.013193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.013193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.013193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.013193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.013442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.013500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] log_config_append = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.013664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.013844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] log_dir = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.014046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] log_file = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.014285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.014538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.014788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.015038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.015218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.015401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.015648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.015895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.016129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.016363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.016596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.016828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.017075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.017322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.017600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.018115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.018302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] publish_errors = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.018536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.018767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.018945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.019194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.019428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.019661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] standard_threads = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.019892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.020135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.020311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.020486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] use_journal = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.020662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] use_json = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.020836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] use_stderr = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.021012 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] use_syslog = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.021242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.021498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.021738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.022018 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.022264 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.022516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.022754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.023002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.023239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.023487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.023735 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.023986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.024222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.024470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.024707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.025009 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.025765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.026033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.026292 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.026548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.026794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.027032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.027287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.027549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.027804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.028056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.028288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.028520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.028752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.028988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.029236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.029486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.029718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.029949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.030224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.030474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.030711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.030961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.031193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.031429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.031665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.031895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.032125 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.032354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.032585 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.032820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.032942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 22:21:56.033064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 22:21:56.033182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.033303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] command line args: [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 22:21:56.033421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.033583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 22:21:56.033700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.033818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ================================================================================ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 22:21:56.033930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.034104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] admin_token = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.034220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.034333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] config_dir = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.034450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.034562 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.034673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.034792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] config_source = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.034792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] debug = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.035002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.035121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.035257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.035382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.035501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.035614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.035724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.035842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.035960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.036081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.036201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.036319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.036437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.037032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] log_config_append = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.037151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.037256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.037256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] log_dir = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.037445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.037546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] log_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.037640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.037743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.037917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.038039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.038157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.038262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.038356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.038456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.038565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.038666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.038774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.038869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.038963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.039061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.039165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.039272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.039371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.039470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.039470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.039693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.039806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.039917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.040028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.040144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.040256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.040376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.040489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.040652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.040652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.040863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.040976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.040976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.041210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.041210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] publish_errors = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.041428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.041428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.041650 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.041746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.041839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.041839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.042026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.042138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.042234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.042328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.042420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.042519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] standard_threads = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.042613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.042715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.042840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.042969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.042969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.043188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.043312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] use_journal = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.043433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.043550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] use_json = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.043550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] use_stderr = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.043767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.043879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] use_syslog = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.043990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.044113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:21:56.044232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.044345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.044457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.044570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.044687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.044809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.044928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.045939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.046990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.047104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.047294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.047450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.047587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.external = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.047709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.047835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.047949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.password = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] auth.token = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048876 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.048988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.049106 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.049291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.049406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.049518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.049638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.049758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.049873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.049994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.050125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.050238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.050350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.050468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.050592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.050725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.050847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.050961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.051073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.051193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.051314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.051435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.051577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.051693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.051805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.051918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.052975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.053990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.054998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055385 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.055968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.056070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.056209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.056315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.056419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.056515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.056609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.056865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.056940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.057968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.058135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.058135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.058364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.058477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.058620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.058620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.058851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.058851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.059116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.059230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.059351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.059466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.059579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.059692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.059805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.059805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.060566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.060685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.060800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.060914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.061942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.062120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.062236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.062350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.062464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.062658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.062777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.062890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.063977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.064098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.064224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.064340 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.064454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.064568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.064694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.064810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.064924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.065957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.066101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.066224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.066340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.066453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.066567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.066680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.066802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.066917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.067963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.068077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.068199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.068314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.068427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.068427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.068902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.external = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069744 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.069982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.070139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.070252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.070366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.password = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.070479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.070603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.token = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.070719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.070833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.070945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.071064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.071178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.071300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.071426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.071542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.071662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.072307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.072431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.072639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.072757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.072873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.072986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.073100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.073213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.073335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.073451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.073564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.073678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.073791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.073905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.074976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.075095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.075210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.075324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.075445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.075561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.075675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.075790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.075903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076018 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.076943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.077976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.078134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.078251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.078371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.078485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.078589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.078702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.078824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.078939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.079979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.080093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.080216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.080351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.080482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.080597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.080710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.080824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.080946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.081061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.081183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.081305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.081421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.081535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.081657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.081772 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.081886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] role.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] role.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.082945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.083986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.084100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.084218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.084331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.084454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.084569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.084682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.084795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.084909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.085022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.085143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.085258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.085371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.085485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.085485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.085698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.085883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086395 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.086972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.087084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.087205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.087320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.087512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.088175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.088291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.088416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.088587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.088708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.088822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.088936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.089975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.090109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.090224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.090337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.090450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.090563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.090688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.090805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.090918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] token.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.091945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.092985 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.093098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.093211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.093323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.093444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.093559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.093672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.093786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.093901 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094508 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.094972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.095086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.095208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.095331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.095447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.095560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.095682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.095797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.095910 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.096951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.097073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.097203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.097382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.097501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.097615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.097728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.097854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.097970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.098139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.098253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.098368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.098471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.098597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.098713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.098827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.098939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099053 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80364) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.099745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] role.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] role.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.101475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.101475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.101475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.101475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.101891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.102016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.102184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.102432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.102695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.102928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.103234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.103484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.103733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.103983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.104387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.104629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.104879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.105129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.105378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.105624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.105859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.106135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.106388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.106627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.106858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.107088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.107319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.107568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.107821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.108074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.108311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.108545 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.108775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.109017 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] token.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.109252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.109499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.109733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.109987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.110255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.110491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.110733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.110974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.111219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.111454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.111691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.111922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.112168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.112415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.112642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.112882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.113183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.113443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.113685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.113933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.114192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.114438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.114673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.114907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.115142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.115377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.115620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.115852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.116094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.116327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.116573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.116806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.117048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.117276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.117513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.117746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:21:56.117915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 22:21:56.127343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.127575 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.127798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.137046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.143168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.143404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.143632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.154227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.165721 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.166149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.172432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.172665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.219191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.219714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.270392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.270625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.272311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.272548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.336954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.337115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.337199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.337331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.337416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.337671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.337759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.337897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.338037 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.338141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.338218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.338354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.361220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.361453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.361547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.361681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.361765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.361927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.362032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.362144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.362227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.362362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.362444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.362577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.362660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.362793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.374375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.374823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.387613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.387846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.388071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.388296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.388518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.388733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.388953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.389608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.389847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.390098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.390324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.390543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.390757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.390971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80364) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 22:21:56.406212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.406421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 22:21:56.406518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.406647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 22:21:56.406755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.406956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 22:21:56.407038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.407169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 22:21:56.407251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.407791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.407883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.407959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.408033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.408117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.408194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.408268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.419485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.419765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.420037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.420321 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.420612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.420888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.421153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.421427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.428433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.429500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.432366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.432642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.432923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.433316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.433399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.433601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.433684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.433869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.434029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.434162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.434281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.434438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.434564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.434710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.434811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.434984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.435069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.435253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.435336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.435588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.435859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.436126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.462327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.463239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.464195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.464477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.464845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.465124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.469784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.470042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.470327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.470410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.470653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.470932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.477581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.477869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.478213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.478495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.482758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.483049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.483147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.483333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.483419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.483615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.483700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.483892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.483979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.484166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.484249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.484434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.484519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.484700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.484784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.484962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.503780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.503973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.504073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.504249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.508560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.508740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.512770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.513064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.513158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.513365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.517994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.518310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.521579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.521870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.525445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.525739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.525831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.526046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.526150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.526338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.526431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.526618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.526702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.526899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.527000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.527216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.545836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.546212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.546312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.546495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.546597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.546768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.546861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.547124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.554681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.555026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.557047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.557416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.557581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.557746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.560502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.560783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.560866 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.561071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.561155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.561347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.561429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.561626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.561716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.561905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.575807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.576086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.576368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.576650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.576910 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.576995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.577193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.577276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.577471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.577643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.577748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.578052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.578337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.578610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.595617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.597201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.598899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.600477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.602222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.604297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.604480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.605911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.606161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.606449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.606733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.607581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.607866 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.608146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.614105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.615526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.615731 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.617127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.619531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.619818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.620097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.620369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.621056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.621348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.621632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.621916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.629603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.629947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.630269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.631105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.631392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.631672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.638156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80364) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.638437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.638724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.639001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.639274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.639564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.639835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.639969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 22:21:56.640100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.640248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.640380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.640526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.640650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.640800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.640929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.641080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.641195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.641365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.641447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.641636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.641726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80364) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.641910 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.642205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.642470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.642762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.643023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.643292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.643555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 22:21:56.681001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621a04929c0 pid: 80364 (default app) May 18 22:21:56.683196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621a04929c0 pid: 80363 (default app) May 18 22:21:56.685106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d65c-421a-45a9-8434-c7c9fec52e95 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:21:56.685400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d65c-421a-45a9-8434-c7c9fec52e95 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:21:56.685681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722d65c-421a-45a9-8434-c7c9fec52e95 None None] PATH_INFO: `/v3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:21:56.689848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Wed May 18 22:21:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:05.582186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8706fa-25e2-43e1-8779-316c4e8bb92a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:05.582760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8706fa-25e2-43e1-8779-316c4e8bb92a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:05.582760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8706fa-25e2-43e1-8779-316c4e8bb92a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:05.587030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:05.592767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:05.593194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:05.593310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:05.660883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: INFO dbcounter [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] Registered counter for database keystone May 18 22:22:05.682254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG oslo_db.sqlalchemy.engines [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80364) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:22:05.688421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writer thread running {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:22:05.863213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG passlib.handlers.bcrypt [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80364) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 18 22:22:05.863549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG passlib.handlers.bcrypt [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80364) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 18 22:22:05.918934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:05.920505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:06.045599 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 18 22:22:06.216680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8706fa-25e2-43e1-8779-316c4e8bb92a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:06.284369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: INFO dbcounter [None req-7f8706fa-25e2-43e1-8779-316c4e8bb92a None None] Registered counter for database keystone May 18 22:22:06.303750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG oslo_db.sqlalchemy.engines [None req-7f8706fa-25e2-43e1-8779-316c4e8bb92a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:22:06.310701 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writer thread running {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:22:06.429649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8706fa-25e2-43e1-8779-316c4e8bb92a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:06.434421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fea62-c17f-4cb9-a80d-b017542e82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:06.435064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fea62-c17f-4cb9-a80d-b017542e82a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:06.435344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fea62-c17f-4cb9-a80d-b017542e82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:06.435618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fea62-c17f-4cb9-a80d-b017542e82a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:06.443907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fea62-c17f-4cb9-a80d-b017542e82a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:06.494917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cc5fea62-c17f-4cb9-a80d-b017542e82a2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 18 22:22:06.495193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fea62-c17f-4cb9-a80d-b017542e82a2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:06.504527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Wed May 18 22:22:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:22:06.510784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:06.524987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12e32-7bc7-494a-baea-97803b0d3479 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:06.529701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cb2dd-6023-4acb-a292-9ed82d65c997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:06.530857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cb2dd-6023-4acb-a292-9ed82d65c997 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:06.531141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cb2dd-6023-4acb-a292-9ed82d65c997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:06.531414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cb2dd-6023-4acb-a292-9ed82d65c997 admin admin] PATH_INFO: `/v3/projects/8c35a2b52a5945feba11f71adc84e226` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:06.532927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cb2dd-6023-4acb-a292-9ed82d65c997 admin admin] RBAC: Authorizing `identity:get_project(project_id=8c35a2b52a5945feba11f71adc84e226)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:06.693819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING keystone.common.rbac_enforcer.enforcer [None req-148cb2dd-6023-4acb-a292-9ed82d65c997 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 18 22:22:06.694538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cb2dd-6023-4acb-a292-9ed82d65c997 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:06.699209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Wed May 18 22:22:06 2022] GET /identity/v3/projects/8c35a2b52a5945feba11f71adc84e226 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:08.860738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071040-cf2e-480a-b49c-64a42c7bcf08 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:08.861312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071040-cf2e-480a-b49c-64a42c7bcf08 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:08.861312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071040-cf2e-480a-b49c-64a42c7bcf08 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:08.865375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:08.871391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e71325-955e-4197-bef7-16eea09e1cdb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:08.871818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e71325-955e-4197-bef7-16eea09e1cdb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:08.871945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e71325-955e-4197-bef7-16eea09e1cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:08.890727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-94e71325-955e-4197-bef7-16eea09e1cdb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:08.892233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-94e71325-955e-4197-bef7-16eea09e1cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:08.900190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 18 22:22:08.923299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28071040-cf2e-480a-b49c-64a42c7bcf08 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:08.935677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28071040-cf2e-480a-b49c-64a42c7bcf08 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:08.939797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65cb58-abcc-44fc-81d3-8392fda65716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:08.940413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cb58-abcc-44fc-81d3-8392fda65716 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:08.940692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cb58-abcc-44fc-81d3-8392fda65716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:08.940964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65cb58-abcc-44fc-81d3-8392fda65716 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:08.948950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65cb58-abcc-44fc-81d3-8392fda65716 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:08.950744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65cb58-abcc-44fc-81d3-8392fda65716 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:08.959273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Wed May 18 22:22:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:22:08.964578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e71325-955e-4197-bef7-16eea09e1cdb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:08.973471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e71325-955e-4197-bef7-16eea09e1cdb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:08.978424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0d0b-f932-4db0-b67f-b150742e43e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:08.979523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0d0b-f932-4db0-b67f-b150742e43e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:08.979802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0d0b-f932-4db0-b67f-b150742e43e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:08.980077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0d0b-f932-4db0-b67f-b150742e43e5 admin admin] PATH_INFO: `/v3/users/45cbea53fb4d428dbebc3700d01065fb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:08.981467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0d0b-f932-4db0-b67f-b150742e43e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=45cbea53fb4d428dbebc3700d01065fb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:08.983320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0d0b-f932-4db0-b67f-b150742e43e5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:08.984873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Wed May 18 22:22:08 2022] GET /identity/v3/users/45cbea53fb4d428dbebc3700d01065fb => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:11.229204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8430-9aa6-406f-b03a-394aaf022fc6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.229758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8430-9aa6-406f-b03a-394aaf022fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.229758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8430-9aa6-406f-b03a-394aaf022fc6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.231131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:11.236178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7fc8-cced-44d4-98e4-368c94e742f2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.236583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7fc8-cced-44d4-98e4-368c94e742f2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.236790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f7fc8-cced-44d4-98e4-368c94e742f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.253763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ba6f7fc8-cced-44d4-98e4-368c94e742f2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:11.254966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ba6f7fc8-cced-44d4-98e4-368c94e742f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:11.333201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 6/11] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:11.343638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d5cc0-2542-4a62-9a32-5ced02313888 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.343925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d5cc0-2542-4a62-9a32-5ced02313888 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.344202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d5cc0-2542-4a62-9a32-5ced02313888 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.345528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 6/12] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:11.350610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc15aba-4ef7-4e3f-846b-65563b444473 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.350905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc15aba-4ef7-4e3f-846b-65563b444473 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.351187 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc15aba-4ef7-4e3f-846b-65563b444473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.356027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d5cc0-2542-4a62-9a32-5ced02313888 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:11.368344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6bc15aba-4ef7-4e3f-846b-65563b444473 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:11.370554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6bc15aba-4ef7-4e3f-846b-65563b444473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:11.387507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:11.438996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:11.462291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc15aba-4ef7-4e3f-846b-65563b444473 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:11.498236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d5cc0-2542-4a62-9a32-5ced02313888 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:11.531381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1fe96-6e7d-4b95-87e9-91d1238abe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:11.532166 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fe96-6e7d-4b95-87e9-91d1238abe53 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.532445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fe96-6e7d-4b95-87e9-91d1238abe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.532717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1fe96-6e7d-4b95-87e9-91d1238abe53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.544491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1fe96-6e7d-4b95-87e9-91d1238abe53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f2b1fe96-6e7d-4b95-87e9-91d1238abe53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:11.555526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:11.557090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:11.557933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:22:11.563332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1fe96-6e7d-4b95-87e9-91d1238abe53 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:11.565027 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc15aba-4ef7-4e3f-846b-65563b444473 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:11.597132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:11.599618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456ae06-8022-4b37-98b6-e23e219f8965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:11.600327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ae06-8022-4b37-98b6-e23e219f8965 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.600668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ae06-8022-4b37-98b6-e23e219f8965 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.601029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ae06-8022-4b37-98b6-e23e219f8965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.623958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:11.667816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1fe96-6e7d-4b95-87e9-91d1238abe53 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:11.672005 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456ae06-8022-4b37-98b6-e23e219f8965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:11.673491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456ae06-8022-4b37-98b6-e23e219f8965 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:11.701597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:11.702290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.702571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.702842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.703581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:11.703898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:11.705271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:11.717261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:11.722745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:11.771297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 22:22:11.776904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456ae06-8022-4b37-98b6-e23e219f8965 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:11.815174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:11.821039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527e312-aa90-449b-94cf-f2f8e90d2043 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:11.828927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:11.855142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bbca4-1a44-466b-a882-11b4fc2b7a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:11.855941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bbca4-1a44-466b-a882-11b4fc2b7a64 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.856214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bbca4-1a44-466b-a882-11b4fc2b7a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.856483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bbca4-1a44-466b-a882-11b4fc2b7a64 None admin] PATH_INFO: `/v3/users/45cbea53fb4d428dbebc3700d01065fb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.858109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bbca4-1a44-466b-a882-11b4fc2b7a64 None admin] RBAC: Authorizing `identity:get_user(user_id=45cbea53fb4d428dbebc3700d01065fb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:11.859586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bbca4-1a44-466b-a882-11b4fc2b7a64 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:11.861201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:11 2022] GET /identity/v3/users/45cbea53fb4d428dbebc3700d01065fb => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:11.866743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bbca4-1a44-466b-a882-11b4fc2b7a64 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:11.875684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456ae06-8022-4b37-98b6-e23e219f8965 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:11.908510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:11.909289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:11.909567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:11.909835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:11.920737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:11.922222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:22:11.942829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:11.943998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:11.944806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:22:11.944806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:22:11.944806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:22:11.944806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:11.944806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:22:11.950462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:11.966218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bbca4-1a44-466b-a882-11b4fc2b7a64 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:11.999794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb877-8bd3-4dee-b8c2-0aeb7f975e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:12.000569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb877-8bd3-4dee-b8c2-0aeb7f975e93 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:12.000848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb877-8bd3-4dee-b8c2-0aeb7f975e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:12.001120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfb877-8bd3-4dee-b8c2-0aeb7f975e93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:12.002400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfb877-8bd3-4dee-b8c2-0aeb7f975e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:12.003823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfb877-8bd3-4dee-b8c2-0aeb7f975e93 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:12.005451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:12.011078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb877-8bd3-4dee-b8c2-0aeb7f975e93 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:12.043301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:12.050900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752643-a97b-4853-8bcb-7a8523466da3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:12.053129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:12.084213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813eb12-d9d9-43ba-9df6-9e3c8a733817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:12.084863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813eb12-d9d9-43ba-9df6-9e3c8a733817 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:12.085142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813eb12-d9d9-43ba-9df6-9e3c8a733817 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:12.085410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813eb12-d9d9-43ba-9df6-9e3c8a733817 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:12.086159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813eb12-d9d9-43ba-9df6-9e3c8a733817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:12.086464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813eb12-d9d9-43ba-9df6-9e3c8a733817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:12.088450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813eb12-d9d9-43ba-9df6-9e3c8a733817 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:12.107088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:12.112029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfb877-8bd3-4dee-b8c2-0aeb7f975e93 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:12.148550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ac7da-ca12-4564-aeaa-d7b40357f545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:12.149214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac7da-ca12-4564-aeaa-d7b40357f545 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:12.149497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac7da-ca12-4564-aeaa-d7b40357f545 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:12.150359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac7da-ca12-4564-aeaa-d7b40357f545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:12.151217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ac7da-ca12-4564-aeaa-d7b40357f545 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.domain.id=default, user.id=45cbea53fb4d428dbebc3700d01065fb) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:12.151529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ac7da-ca12-4564-aeaa-d7b40357f545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:12.153009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ac7da-ca12-4564-aeaa-d7b40357f545 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:12.162380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1322 bytes} [Wed May 18 22:22:12 2022] GET /identity/v3/role_assignments?user.id=45cbea53fb4d428dbebc3700d01065fb&scope.domain.id=default&role.id=fe643140d2134736a54afd972d47d43f => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:14.771414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129943c-37a0-482e-bfeb-3658fbcb7568 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:14.771977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129943c-37a0-482e-bfeb-3658fbcb7568 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:14.771977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129943c-37a0-482e-bfeb-3658fbcb7568 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:14.773397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:14.780071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:14.781057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:14.781531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:14.803253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG passlib.handlers.bcrypt [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80363) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 18 22:22:14.803992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG passlib.handlers.bcrypt [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80363) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 18 22:22:14.868612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:14.870543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:14.957628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a9d1-969e-4110-9b34-868a02f40994 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:14.958288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a9d1-969e-4110-9b34-868a02f40994 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:14.958768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a9d1-969e-4110-9b34-868a02f40994 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:14.961246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 12/23] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:22:14.967290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec6bb-31a8-41f2-94a5-12337327c978 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:14.967830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec6bb-31a8-41f2-94a5-12337327c978 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:14.968318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdec6bb-31a8-41f2-94a5-12337327c978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:15.000651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-bfdec6bb-31a8-41f2-94a5-12337327c978 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:15.003158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bfdec6bb-31a8-41f2-94a5-12337327c978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:15.028413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 12/24] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:15.109937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:15.147626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 13/25] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:15.187171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec6bb-31a8-41f2-94a5-12337327c978 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:15.307299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:15.345685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdec6bb-31a8-41f2-94a5-12337327c978 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:15.353449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:15.426210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c378d95-8aad-49f9-8ac6-3b004285b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:15.428352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378d95-8aad-49f9-8ac6-3b004285b24d None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:15.429869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378d95-8aad-49f9-8ac6-3b004285b24d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:15.430366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c378d95-8aad-49f9-8ac6-3b004285b24d None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:15.432053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c378d95-8aad-49f9-8ac6-3b004285b24d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:15.436217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c378d95-8aad-49f9-8ac6-3b004285b24d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:15.458999 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc951aad-0293-43fa-8922-e91f17919984 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:15.495648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effb237-b9a8-4e72-8a95-8dbf576ca4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:15.497073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb237-b9a8-4e72-8a95-8dbf576ca4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:15.497569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb237-b9a8-4e72-8a95-8dbf576ca4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:15.498076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effb237-b9a8-4e72-8a95-8dbf576ca4f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:15.510404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effb237-b9a8-4e72-8a95-8dbf576ca4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0effb237-b9a8-4e72-8a95-8dbf576ca4f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:15.519173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:15.526969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 13/26] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:22:15.527736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38ca0-c87c-49d3-b2f4-f1e6139552b2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:15.530656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38ca0-c87c-49d3-b2f4-f1e6139552b2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:15.531189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e38ca0-c87c-49d3-b2f4-f1e6139552b2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:15.532758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:15.533659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e38ca0-c87c-49d3-b2f4-f1e6139552b2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:15.644012 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:15.662631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e38ca0-c87c-49d3-b2f4-f1e6139552b2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:15.700416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16ba4b-7f88-4eee-907a-91bb814302f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:15.701575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ba4b-7f88-4eee-907a-91bb814302f2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:15.702142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ba4b-7f88-4eee-907a-91bb814302f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:15.702698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16ba4b-7f88-4eee-907a-91bb814302f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:15.703663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16ba4b-7f88-4eee-907a-91bb814302f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:15.704163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16ba4b-7f88-4eee-907a-91bb814302f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:15.705802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16ba4b-7f88-4eee-907a-91bb814302f2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:15.715095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 15/28] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:15.721396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d48f-bce0-4639-a8d9-63604c801fdd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:15.721899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d48f-bce0-4639-a8d9-63604c801fdd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:15.722421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804d48f-bce0-4639-a8d9-63604c801fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:15.740745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c804d48f-bce0-4639-a8d9-63604c801fdd None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:15.742375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c804d48f-bce0-4639-a8d9-63604c801fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:15.781385 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 14/29] 10.222.0.70 () {60 vars in 1131 bytes} [Wed May 18 22:22:15 2022] POST /identity/v3/roles => generated 219 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:22:15.782619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8dd53-0994-4fbc-b41f-c27b9119638b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:15.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8dd53-0994-4fbc-b41f-c27b9119638b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:15.783185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8dd53-0994-4fbc-b41f-c27b9119638b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:15.784694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 15/30] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:15.785180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8dd53-0994-4fbc-b41f-c27b9119638b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:15.822238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 16/31] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:15.824278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7d47-8e6c-4914-8a83-1fb84c315f16 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:15.824815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7d47-8e6c-4914-8a83-1fb84c315f16 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:15.825306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7d47-8e6c-4914-8a83-1fb84c315f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:15.843862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7b0e7d47-8e6c-4914-8a83-1fb84c315f16 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:15.845424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7b0e7d47-8e6c-4914-8a83-1fb84c315f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:15.962828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 17/32] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:15.964105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e7d47-8e6c-4914-8a83-1fb84c315f16 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:15.975046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:16.106967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e7d47-8e6c-4914-8a83-1fb84c315f16 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:16.122619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8dd53-0994-4fbc-b41f-c27b9119638b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:16.157885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2ffeb-52b8-4815-8f08-9b7c288bc150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:16.158754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ffeb-52b8-4815-8f08-9b7c288bc150 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.159301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ffeb-52b8-4815-8f08-9b7c288bc150 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.159301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2ffeb-52b8-4815-8f08-9b7c288bc150 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.160059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2ffeb-52b8-4815-8f08-9b7c288bc150 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:16.161446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2ffeb-52b8-4815-8f08-9b7c288bc150 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:16.170523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e65b-0aa0-49a5-b339-da5a8c5b6abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:16.171415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e65b-0aa0-49a5-b339-da5a8c5b6abe None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.171697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e65b-0aa0-49a5-b339-da5a8c5b6abe None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.171973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e65b-0aa0-49a5-b339-da5a8c5b6abe None admin] PATH_INFO: `/v3/users/45cbea53fb4d428dbebc3700d01065fb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.173446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e65b-0aa0-49a5-b339-da5a8c5b6abe None admin] RBAC: Authorizing `identity:get_user(user_id=45cbea53fb4d428dbebc3700d01065fb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:16.175154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e65b-0aa0-49a5-b339-da5a8c5b6abe None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:16.177016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 16/33] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:15 2022] GET /identity/v3/users/45cbea53fb4d428dbebc3700d01065fb => generated 247 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:16.178181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e65b-0aa0-49a5-b339-da5a8c5b6abe None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:16.207569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:16.290877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e65b-0aa0-49a5-b339-da5a8c5b6abe None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:16.326464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 18/34] 10.222.0.70 () {60 vars in 1131 bytes} [Wed May 18 22:22:15 2022] POST /identity/v3/roles => generated 225 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:16.327786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14315a9-9df7-4f95-8fd7-5ceb73d050c1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.327987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e3804-bd46-4eff-a4c4-a35c66aaf6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:16.328098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14315a9-9df7-4f95-8fd7-5ceb73d050c1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.328335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14315a9-9df7-4f95-8fd7-5ceb73d050c1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.328723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e3804-bd46-4eff-a4c4-a35c66aaf6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.329008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e3804-bd46-4eff-a4c4-a35c66aaf6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.329286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e3804-bd46-4eff-a4c4-a35c66aaf6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.329769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 19/35] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:16.334129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14315a9-9df7-4f95-8fd7-5ceb73d050c1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:16.351725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e3804-bd46-4eff-a4c4-a35c66aaf6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:16.354750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e3804-bd46-4eff-a4c4-a35c66aaf6e0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-926e3804-bd46-4eff-a4c4-a35c66aaf6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:22:16.381505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:16.383357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:16.385199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:22:16.385199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:22:16.385199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:22:16.385199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:16.385199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 17/36] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:16.385199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db71ef-69d2-4a10-9853-33cb8acc5b54 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.385199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db71ef-69d2-4a10-9853-33cb8acc5b54 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.385691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db71ef-69d2-4a10-9853-33cb8acc5b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.410140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e9db71ef-69d2-4a10-9853-33cb8acc5b54 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:16.412531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e9db71ef-69d2-4a10-9853-33cb8acc5b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:16.424703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:16.470321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14315a9-9df7-4f95-8fd7-5ceb73d050c1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:16.509903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 18/37] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:16.511336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db71ef-69d2-4a10-9853-33cb8acc5b54 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:16.511458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f7ceb-a8cd-4bc5-b217-dade13053a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:16.511983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7ceb-a8cd-4bc5-b217-dade13053a74 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.512279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7ceb-a8cd-4bc5-b217-dade13053a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.512585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f7ceb-a8cd-4bc5-b217-dade13053a74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.514408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f7ceb-a8cd-4bc5-b217-dade13053a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:16.516021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f7ceb-a8cd-4bc5-b217-dade13053a74 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:16.517792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:16.523236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f33e8-6999-403d-b908-71d4b17d65e0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.523236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f33e8-6999-403d-b908-71d4b17d65e0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.523236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f33e8-6999-403d-b908-71d4b17d65e0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.523514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:16.523585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 21/39] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:16.523585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f33e8-6999-403d-b908-71d4b17d65e0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:16.626521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db71ef-69d2-4a10-9853-33cb8acc5b54 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:16.637968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f33e8-6999-403d-b908-71d4b17d65e0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:16.660190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455b4c1-2f9c-4fee-9135-f6b8cba37952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:16.660850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b4c1-2f9c-4fee-9135-f6b8cba37952 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.661126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b4c1-2f9c-4fee-9135-f6b8cba37952 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.661401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455b4c1-2f9c-4fee-9135-f6b8cba37952 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.662146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b4c1-2f9c-4fee-9135-f6b8cba37952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:16.662452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b4c1-2f9c-4fee-9135-f6b8cba37952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:16.663838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455b4c1-2f9c-4fee-9135-f6b8cba37952 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:16.670958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2257-93e0-4d95-9c40-f4918a85accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:16.671829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2257-93e0-4d95-9c40-f4918a85accd None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.672114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2257-93e0-4d95-9c40-f4918a85accd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.672394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2257-93e0-4d95-9c40-f4918a85accd None admin] PATH_INFO: `/v3/domains/default/users/45cbea53fb4d428dbebc3700d01065fb/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.674745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a2257-93e0-4d95-9c40-f4918a85accd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=45cbea53fb4d428dbebc3700d01065fb, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:16.679318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 19/40] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:16.679442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a2257-93e0-4d95-9c40-f4918a85accd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:16.679515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a9f4-f930-402b-880b-2e6c7fd10c1a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.679515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a9f4-f930-402b-880b-2e6c7fd10c1a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.679515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002a9f4-f930-402b-880b-2e6c7fd10c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.680442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:16.693933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9002a9f4-f930-402b-880b-2e6c7fd10c1a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:16.695134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9002a9f4-f930-402b-880b-2e6c7fd10c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:16.751474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:16.760013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 20/41] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:16.760795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002a9f4-f930-402b-880b-2e6c7fd10c1a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:16.763680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 22/42] 10.222.0.70 () {58 vars in 1361 bytes} [Wed May 18 22:22:16 2022] PUT /identity/v3/domains/default/users/45cbea53fb4d428dbebc3700d01065fb/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:22:16.764485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2257-93e0-4d95-9c40-f4918a85accd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:16.883928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2257-93e0-4d95-9c40-f4918a85accd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:16.889367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002a9f4-f930-402b-880b-2e6c7fd10c1a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:16.924185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77034f3d-359a-47a5-9b25-27d3cb2f4015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:16.924853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77034f3d-359a-47a5-9b25-27d3cb2f4015 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.925137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77034f3d-359a-47a5-9b25-27d3cb2f4015 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.925413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77034f3d-359a-47a5-9b25-27d3cb2f4015 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.926172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77034f3d-359a-47a5-9b25-27d3cb2f4015 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:16.927659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77034f3d-359a-47a5-9b25-27d3cb2f4015 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:16.932209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba58f3b-a4cc-4383-b1a5-0c38fdd2dea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:16.933491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58f3b-a4cc-4383-b1a5-0c38fdd2dea4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:16.933967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58f3b-a4cc-4383-b1a5-0c38fdd2dea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:16.934483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba58f3b-a4cc-4383-b1a5-0c38fdd2dea4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:16.936532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba58f3b-a4cc-4383-b1a5-0c38fdd2dea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:16.938316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba58f3b-a4cc-4383-b1a5-0c38fdd2dea4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:16.940208 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:16.941183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba58f3b-a4cc-4383-b1a5-0c38fdd2dea4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:17.013322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:17.035938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:22:16 2022] POST /identity/v3/projects => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:17.043228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77034f3d-359a-47a5-9b25-27d3cb2f4015 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:17.061842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba58f3b-a4cc-4383-b1a5-0c38fdd2dea4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:17.104465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba538ab9-878d-46cc-a244-ae101449607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:17.105439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba538ab9-878d-46cc-a244-ae101449607d None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:17.105716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba538ab9-878d-46cc-a244-ae101449607d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:17.105993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba538ab9-878d-46cc-a244-ae101449607d None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:17.106796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba538ab9-878d-46cc-a244-ae101449607d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:17.108235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba538ab9-878d-46cc-a244-ae101449607d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:17.115599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:17.176699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1131 bytes} [Wed May 18 22:22:16 2022] POST /identity/v3/roles => generated 223 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:17.177004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77034f3d-359a-47a5-9b25-27d3cb2f4015 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:17.227256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6900b-80e4-4153-b573-9dc3f785bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:17.228619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6900b-80e4-4153-b573-9dc3f785bfd9 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:17.229079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6900b-80e4-4153-b573-9dc3f785bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:17.229371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6900b-80e4-4153-b573-9dc3f785bfd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:17.230333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6900b-80e4-4153-b573-9dc3f785bfd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:17.231980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6900b-80e4-4153-b573-9dc3f785bfd9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:17.326439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:22:17 2022] POST /identity/v3/projects => generated 312 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:19.053589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c74b1-5364-4200-a465-8328b921ebce None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.054148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c74b1-5364-4200-a465-8328b921ebce None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.054233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c74b1-5364-4200-a465-8328b921ebce None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.055712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 23/47] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:19.060972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1457-c8a4-4f86-be5e-96a87733d256 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.061345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1457-c8a4-4f86-be5e-96a87733d256 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.061562 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1457-c8a4-4f86-be5e-96a87733d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.078807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ed0a1457-c8a4-4f86-be5e-96a87733d256 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:19.080301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ed0a1457-c8a4-4f86-be5e-96a87733d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:19.147809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 25/48] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:19.171268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c74b1-5364-4200-a465-8328b921ebce None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:19.271299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c74b1-5364-4200-a465-8328b921ebce None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:19.293846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:19.304621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e22c1-b44c-4f87-8cf8-024aa75b8094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:19.305349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e22c1-b44c-4f87-8cf8-024aa75b8094 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.305631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e22c1-b44c-4f87-8cf8-024aa75b8094 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.305958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e22c1-b44c-4f87-8cf8-024aa75b8094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.317312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e22c1-b44c-4f87-8cf8-024aa75b8094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-aa9e22c1-b44c-4f87-8cf8-024aa75b8094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:19.327178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:19.328082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:19.328837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:19.329967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 24/49] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:19.334257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a1457-c8a4-4f86-be5e-96a87733d256 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:19.366064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:19.436514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a1457-c8a4-4f86-be5e-96a87733d256 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:19.470296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355def6-31af-4b69-a04e-4aa74e4fb471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:19.470952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355def6-31af-4b69-a04e-4aa74e4fb471 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.471233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355def6-31af-4b69-a04e-4aa74e4fb471 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.471509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355def6-31af-4b69-a04e-4aa74e4fb471 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.472252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355def6-31af-4b69-a04e-4aa74e4fb471 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:19.472556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355def6-31af-4b69-a04e-4aa74e4fb471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:19.473928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355def6-31af-4b69-a04e-4aa74e4fb471 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:19.482534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 26/50] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:19.487971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e22c1-b44c-4f87-8cf8-024aa75b8094 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:19.547975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29324f-6153-41cd-a443-97c978ce4a58 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.548271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29324f-6153-41cd-a443-97c978ce4a58 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.548551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29324f-6153-41cd-a443-97c978ce4a58 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.549922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 27/51] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:22:19.554926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05df219-407e-4159-bd34-276c97b7d3a7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.555243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05df219-407e-4159-bd34-276c97b7d3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.555531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05df219-407e-4159-bd34-276c97b7d3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.571798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d05df219-407e-4159-bd34-276c97b7d3a7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:19.572969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d05df219-407e-4159-bd34-276c97b7d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:19.589289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e22c1-b44c-4f87-8cf8-024aa75b8094 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:19.623322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b0eb8-5832-49f3-9e6f-0523e3df8987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:19.624192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b0eb8-5832-49f3-9e6f-0523e3df8987 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.624475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b0eb8-5832-49f3-9e6f-0523e3df8987 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.624750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b0eb8-5832-49f3-9e6f-0523e3df8987 None admin] PATH_INFO: `/v3/users/45cbea53fb4d428dbebc3700d01065fb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.625930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b0eb8-5832-49f3-9e6f-0523e3df8987 None admin] RBAC: Authorizing `identity:get_user(user_id=45cbea53fb4d428dbebc3700d01065fb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:19.627396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b0eb8-5832-49f3-9e6f-0523e3df8987 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:19.629033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 25/52] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:19 2022] GET /identity/v3/users/45cbea53fb4d428dbebc3700d01065fb => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:19.634927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b0eb8-5832-49f3-9e6f-0523e3df8987 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:19.639586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 28/53] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:19.662505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05df219-407e-4159-bd34-276c97b7d3a7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:19.687946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:19.688112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:19.737767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b0eb8-5832-49f3-9e6f-0523e3df8987 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:19.764751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05df219-407e-4159-bd34-276c97b7d3a7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:19.770634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cadd20-50e8-426d-a57b-3e10ec63af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:19.771420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadd20-50e8-426d-a57b-3e10ec63af5b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.771705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadd20-50e8-426d-a57b-3e10ec63af5b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.771982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cadd20-50e8-426d-a57b-3e10ec63af5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.773138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cadd20-50e8-426d-a57b-3e10ec63af5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:19.775180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cadd20-50e8-426d-a57b-3e10ec63af5b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:19.777122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 26/54] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:19.782329 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cadd20-50e8-426d-a57b-3e10ec63af5b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:19.802392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebcdb8-4cd6-46ce-aa90-85e1be112d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:19.803181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebcdb8-4cd6-46ce-aa90-85e1be112d45 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.803461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebcdb8-4cd6-46ce-aa90-85e1be112d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.803736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebcdb8-4cd6-46ce-aa90-85e1be112d45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.804888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebcdb8-4cd6-46ce-aa90-85e1be112d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:19.806519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebcdb8-4cd6-46ce-aa90-85e1be112d45 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:19.808174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 29/55] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:19.813528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebcdb8-4cd6-46ce-aa90-85e1be112d45 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:19.881026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cadd20-50e8-426d-a57b-3e10ec63af5b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:19.898647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:19.901331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:19.910570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebcdb8-4cd6-46ce-aa90-85e1be112d45 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:19.915748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5caf9-330f-48f2-b4ca-c5ec21684b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:19.916396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5caf9-330f-48f2-b4ca-c5ec21684b9f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.916677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5caf9-330f-48f2-b4ca-c5ec21684b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.916953 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5caf9-330f-48f2-b4ca-c5ec21684b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.917784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5caf9-330f-48f2-b4ca-c5ec21684b9f None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.domain.id=default, user.id=45cbea53fb4d428dbebc3700d01065fb) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:19.918189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5caf9-330f-48f2-b4ca-c5ec21684b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:19.919650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5caf9-330f-48f2-b4ca-c5ec21684b9f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:19.927387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 27/56] 10.222.0.70 () {56 vars in 1322 bytes} [Wed May 18 22:22:19 2022] GET /identity/v3/role_assignments?user.id=45cbea53fb4d428dbebc3700d01065fb&scope.domain.id=default&role.id=fe643140d2134736a54afd972d47d43f => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:19.944474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706040d0-6fcf-4b9f-91e9-c6c0d1df2658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:19.945158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706040d0-6fcf-4b9f-91e9-c6c0d1df2658 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:19.945442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706040d0-6fcf-4b9f-91e9-c6c0d1df2658 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:19.945723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706040d0-6fcf-4b9f-91e9-c6c0d1df2658 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:19.947021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706040d0-6fcf-4b9f-91e9-c6c0d1df2658 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:19.948517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706040d0-6fcf-4b9f-91e9-c6c0d1df2658 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:20.038814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 30/57] 10.222.0.70 () {60 vars in 1140 bytes} [Wed May 18 22:22:19 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:22:22.237466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558f48-8435-4731-8093-a3c9fe6125c3 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:22.237982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558f48-8435-4731-8093-a3c9fe6125c3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:22.238096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00558f48-8435-4731-8093-a3c9fe6125c3 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:22.239600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 28/58] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:22.244966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116d91-6f00-4507-ab89-46ccd4ee02ba None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:22.245370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116d91-6f00-4507-ab89-46ccd4ee02ba None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:22.245546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d116d91-6f00-4507-ab89-46ccd4ee02ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:22.262709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5d116d91-6f00-4507-ab89-46ccd4ee02ba None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:22.263883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5d116d91-6f00-4507-ab89-46ccd4ee02ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:22.329200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 31/59] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:22.353720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558f48-8435-4731-8093-a3c9fe6125c3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:22.451689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00558f48-8435-4731-8093-a3c9fe6125c3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:22.483607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0ed92-836d-4deb-829b-f8431bcf57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:22.484373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ed92-836d-4deb-829b-f8431bcf57cc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:22.484653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ed92-836d-4deb-829b-f8431bcf57cc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:22.484924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0ed92-836d-4deb-829b-f8431bcf57cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:22.486094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0ed92-836d-4deb-829b-f8431bcf57cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:22.487531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac0ed92-836d-4deb-829b-f8431bcf57cc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:22.489098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 29/60] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:22.495158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d116d91-6f00-4507-ab89-46ccd4ee02ba None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:22.562248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:22.590918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d116d91-6f00-4507-ab89-46ccd4ee02ba None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:22.624671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627521eb-ec5b-4ee1-ac0b-ab3b1b3c6857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:22.625322 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627521eb-ec5b-4ee1-ac0b-ab3b1b3c6857 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:22.625603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627521eb-ec5b-4ee1-ac0b-ab3b1b3c6857 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:22.625875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627521eb-ec5b-4ee1-ac0b-ab3b1b3c6857 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:22.626599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627521eb-ec5b-4ee1-ac0b-ab3b1b3c6857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:22.628008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627521eb-ec5b-4ee1-ac0b-ab3b1b3c6857 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:22.721850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 32/61] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:22:22 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:25.971265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157bb1-0a37-49a8-81d6-4d96920bf3f8 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:25.971774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157bb1-0a37-49a8-81d6-4d96920bf3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:25.971846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1157bb1-0a37-49a8-81d6-4d96920bf3f8 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:25.973165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 30/62] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:25.978737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852099cf-16a4-4e34-b265-e0500de87c72 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:25.979159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852099cf-16a4-4e34-b265-e0500de87c72 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:25.979333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852099cf-16a4-4e34-b265-e0500de87c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.002831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-852099cf-16a4-4e34-b265-e0500de87c72 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:26.004034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-852099cf-16a4-4e34-b265-e0500de87c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:26.111786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 33/63] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:26.147370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157bb1-0a37-49a8-81d6-4d96920bf3f8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:26.223458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:26.246261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab263a-0265-4368-bdc9-2e7c8edb1d34 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.246804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab263a-0265-4368-bdc9-2e7c8edb1d34 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.247398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab263a-0265-4368-bdc9-2e7c8edb1d34 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.249092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 34/64] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:26.254380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44d83f-f224-439d-abfa-82521a2469c0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.254848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44d83f-f224-439d-abfa-82521a2469c0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.255295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44d83f-f224-439d-abfa-82521a2469c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.290159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ab44d83f-f224-439d-abfa-82521a2469c0 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:26.293510 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ab44d83f-f224-439d-abfa-82521a2469c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:26.311161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1157bb1-0a37-49a8-81d6-4d96920bf3f8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:26.357730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680bc2a-ac8b-49cd-b191-c36e8654feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:26.358948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:26.360858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680bc2a-ac8b-49cd-b191-c36e8654feac None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.361298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680bc2a-ac8b-49cd-b191-c36e8654feac None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.361873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680bc2a-ac8b-49cd-b191-c36e8654feac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.374210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 35/65] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:26.375911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ca43-a27a-4758-9b16-0e2d8a074e54 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.376059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680bc2a-ac8b-49cd-b191-c36e8654feac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:26.376468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ca43-a27a-4758-9b16-0e2d8a074e54 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.376932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6ca43-a27a-4758-9b16-0e2d8a074e54 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.378533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 36/66] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:26.384363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6f886-f480-4e80-a647-3c3f4bd340db None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.384909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6f886-f480-4e80-a647-3c3f4bd340db None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9680bc2a-ac8b-49cd-b191-c36e8654feac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:26.385326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:26.386269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:26.387168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 31/67] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:26.388170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6f886-f480-4e80-a647-3c3f4bd340db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.392724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680bc2a-ac8b-49cd-b191-c36e8654feac None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:26.407113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-daa6f886-f480-4e80-a647-3c3f4bd340db None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:26.408987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-daa6f886-f480-4e80-a647-3c3f4bd340db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:26.484927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 37/68] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:26.486813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6f886-f480-4e80-a647-3c3f4bd340db None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:26.514472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680bc2a-ac8b-49cd-b191-c36e8654feac None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:26.526798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:26.549803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e1a8f-4c21-4d5b-b627-db7b4722f9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:26.550530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e1a8f-4c21-4d5b-b627-db7b4722f9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.550814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e1a8f-4c21-4d5b-b627-db7b4722f9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.551091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e1a8f-4c21-4d5b-b627-db7b4722f9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.551832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e1a8f-4c21-4d5b-b627-db7b4722f9f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:26.552138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e1a8f-4c21-4d5b-b627-db7b4722f9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:26.553521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e1a8f-4c21-4d5b-b627-db7b4722f9f7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:26.570060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 32/69] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:26.570060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e0ded-ef14-431f-994b-c6fbb8d3869f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.570060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e0ded-ef14-431f-994b-c6fbb8d3869f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.570060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e0ded-ef14-431f-994b-c6fbb8d3869f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 33/70] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:26.574851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e0ded-ef14-431f-994b-c6fbb8d3869f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:26.609240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6f886-f480-4e80-a647-3c3f4bd340db None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:26.627828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:26.645686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f5e49-880f-47d1-bba7-2e4310650e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:26.646578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5e49-880f-47d1-bba7-2e4310650e65 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.646898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5e49-880f-47d1-bba7-2e4310650e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.647185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5e49-880f-47d1-bba7-2e4310650e65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.657991 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f5e49-880f-47d1-bba7-2e4310650e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0a4f5e49-880f-47d1-bba7-2e4310650e65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:26.666988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:26.667867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:26.668655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 38/71] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:22:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:26.669784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076156d1-5f65-43eb-88b8-95c89ed68323 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.669784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076156d1-5f65-43eb-88b8-95c89ed68323 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.670042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076156d1-5f65-43eb-88b8-95c89ed68323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.686700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-076156d1-5f65-43eb-88b8-95c89ed68323 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:26.687841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-076156d1-5f65-43eb-88b8-95c89ed68323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:26.688336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e0ded-ef14-431f-994b-c6fbb8d3869f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:26.727142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a024941-7e07-43f0-8756-26423b289997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:26.728022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a024941-7e07-43f0-8756-26423b289997 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.728295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a024941-7e07-43f0-8756-26423b289997 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.728566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a024941-7e07-43f0-8756-26423b289997 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.739253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a024941-7e07-43f0-8756-26423b289997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0a024941-7e07-43f0-8756-26423b289997 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:26.747010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:26.747891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:26.748699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 34/72] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:26.750094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a024941-7e07-43f0-8756-26423b289997 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:26.774208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 39/73] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:26.774208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076156d1-5f65-43eb-88b8-95c89ed68323 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:26.794629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:26.870693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a024941-7e07-43f0-8756-26423b289997 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:26.874940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076156d1-5f65-43eb-88b8-95c89ed68323 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:26.885070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:26.907213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700e400-70e9-4296-8c2e-c2480d538dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:26.908396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700e400-70e9-4296-8c2e-c2480d538dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.908997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700e400-70e9-4296-8c2e-c2480d538dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.909447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700e400-70e9-4296-8c2e-c2480d538dd6 None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.910257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:26.910930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:26.911406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:26.911896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:26.913104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:26.914228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:26.915836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:26.924714 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700e400-70e9-4296-8c2e-c2480d538dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:26.925237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 40/74] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:22:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:26.925806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:26.930514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700e400-70e9-4296-8c2e-c2480d538dd6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:26.932440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 35/75] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:26 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:26.933251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700e400-70e9-4296-8c2e-c2480d538dd6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.030795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.034292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbaab6-adf1-4b5e-a4e7-8a62d2a849ce None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.040055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700e400-70e9-4296-8c2e-c2480d538dd6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.072047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.072704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.072985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.073266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.074027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:27.074337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.075748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.078604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b3ee4-f439-4ca6-b7c7-1c04574f1151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.079394 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b3ee4-f439-4ca6-b7c7-1c04574f1151 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.079671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b3ee4-f439-4ca6-b7c7-1c04574f1151 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.079939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b3ee4-f439-4ca6-b7c7-1c04574f1151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.084023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 41/76] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:27.084822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.090885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b3ee4-f439-4ca6-b7c7-1c04574f1151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-707b3ee4-f439-4ca6-b7c7-1c04574f1151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:27.098571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:27.099613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 36/77] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:27.100577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b3ee4-f439-4ca6-b7c7-1c04574f1151 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.120991 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.190581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf30008-5bf9-4d16-b190-26ce292cb6c6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.197344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b3ee4-f439-4ca6-b7c7-1c04574f1151 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.224281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160ea0-0040-4767-a9f4-9635fb0b2e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.225147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160ea0-0040-4767-a9f4-9635fb0b2e31 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.225429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160ea0-0040-4767-a9f4-9635fb0b2e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.225712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160ea0-0040-4767-a9f4-9635fb0b2e31 None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.226919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0160ea0-0040-4767-a9f4-9635fb0b2e31 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.229413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0160ea0-0040-4767-a9f4-9635fb0b2e31 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.230813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddced4-e653-49b7-9f50-5dc4fe016ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.231076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 42/78] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:27.231455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddced4-e653-49b7-9f50-5dc4fe016ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.231736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddced4-e653-49b7-9f50-5dc4fe016ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.232010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddced4-e653-49b7-9f50-5dc4fe016ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.232237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab7c06-370a-43ed-89ac-6f6872435679 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.232584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab7c06-370a-43ed-89ac-6f6872435679 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.232806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab7c06-370a-43ed-89ac-6f6872435679 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 43/79] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:27.238622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab7c06-370a-43ed-89ac-6f6872435679 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.251279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.299804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddced4-e653-49b7-9f50-5dc4fe016ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.301224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddced4-e653-49b7-9f50-5dc4fe016ef8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.335608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.341451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab7c06-370a-43ed-89ac-6f6872435679 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.375908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d55a93-7610-40eb-84ce-2da51179374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.376867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55a93-7610-40eb-84ce-2da51179374c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.377223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55a93-7610-40eb-84ce-2da51179374c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.377551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55a93-7610-40eb-84ce-2da51179374c None admin] PATH_INFO: `/v3/users/45cbea53fb4d428dbebc3700d01065fb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.378830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d55a93-7610-40eb-84ce-2da51179374c None admin] RBAC: Authorizing `identity:get_user(user_id=45cbea53fb4d428dbebc3700d01065fb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.380262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d55a93-7610-40eb-84ce-2da51179374c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.381905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 44/80] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/users/45cbea53fb4d428dbebc3700d01065fb => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:27.382684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d55a93-7610-40eb-84ce-2da51179374c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.400678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 37/81] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:27.401513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddced4-e653-49b7-9f50-5dc4fe016ef8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.449812 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.483101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d55a93-7610-40eb-84ce-2da51179374c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.498873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddced4-e653-49b7-9f50-5dc4fe016ef8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.516391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcde569-bd14-45b7-9783-a98729e17f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.517047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde569-bd14-45b7-9783-a98729e17f24 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.517328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde569-bd14-45b7-9783-a98729e17f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.517605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcde569-bd14-45b7-9783-a98729e17f24 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.518381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde569-bd14-45b7-9783-a98729e17f24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:27.518689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde569-bd14-45b7-9783-a98729e17f24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.520049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcde569-bd14-45b7-9783-a98729e17f24 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.527936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 45/82] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:27.527936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4081e02-f020-49aa-b79f-ac85f2ea48a1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.527936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4081e02-f020-49aa-b79f-ac85f2ea48a1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.527936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4081e02-f020-49aa-b79f-ac85f2ea48a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.532626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889757d-9a30-4428-a0ce-be84827c146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.532729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889757d-9a30-4428-a0ce-be84827c146b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.533006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889757d-9a30-4428-a0ce-be84827c146b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.533282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889757d-9a30-4428-a0ce-be84827c146b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.545675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c4081e02-f020-49aa-b79f-ac85f2ea48a1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:27.546889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c4081e02-f020-49aa-b79f-ac85f2ea48a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:27.570268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.599654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889757d-9a30-4428-a0ce-be84827c146b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.601120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889757d-9a30-4428-a0ce-be84827c146b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.612210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 46/83] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:27.613037 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4081e02-f020-49aa-b79f-ac85f2ea48a1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.651651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.701678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 38/84] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:27.702546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889757d-9a30-4428-a0ce-be84827c146b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.715265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4081e02-f020-49aa-b79f-ac85f2ea48a1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.750400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779203f-0746-4e02-abf0-b7f3412f16fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.751042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779203f-0746-4e02-abf0-b7f3412f16fe None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.751328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779203f-0746-4e02-abf0-b7f3412f16fe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.751603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779203f-0746-4e02-abf0-b7f3412f16fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.779360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.801668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889757d-9a30-4428-a0ce-be84827c146b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.819771 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779203f-0746-4e02-abf0-b7f3412f16fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.821289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779203f-0746-4e02-abf0-b7f3412f16fe None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.840182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610efe4e-d8e0-4d18-86b4-6b6bc2d073b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.841028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610efe4e-d8e0-4d18-86b4-6b6bc2d073b3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.841303 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610efe4e-d8e0-4d18-86b4-6b6bc2d073b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.841572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610efe4e-d8e0-4d18-86b4-6b6bc2d073b3 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.842752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610efe4e-d8e0-4d18-86b4-6b6bc2d073b3 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.844193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610efe4e-d8e0-4d18-86b4-6b6bc2d073b3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.846056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 39/85] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:27.846654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610efe4e-d8e0-4d18-86b4-6b6bc2d073b3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.864716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:27.924064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 47/86] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:27.925224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779203f-0746-4e02-abf0-b7f3412f16fe None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.943037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610efe4e-d8e0-4d18-86b4-6b6bc2d073b3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:27.977298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d55ce-cedb-4c33-9aad-b2a7d07a44b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:27.979389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d55ce-cedb-4c33-9aad-b2a7d07a44b1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:27.979677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d55ce-cedb-4c33-9aad-b2a7d07a44b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:27.979983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d55ce-cedb-4c33-9aad-b2a7d07a44b1 None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:27.981193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d55ce-cedb-4c33-9aad-b2a7d07a44b1 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:27.982723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d55ce-cedb-4c33-9aad-b2a7d07a44b1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:27.984342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 40/87] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:27.985101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d55ce-cedb-4c33-9aad-b2a7d07a44b1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:27.986455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:28.028333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779203f-0746-4e02-abf0-b7f3412f16fe None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.066613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0da45f-b7d2-4114-8435-c9364e7ddcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.067405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0da45f-b7d2-4114-8435-c9364e7ddcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.067686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0da45f-b7d2-4114-8435-c9364e7ddcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.067958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0da45f-b7d2-4114-8435-c9364e7ddcb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.069389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0da45f-b7d2-4114-8435-c9364e7ddcb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.070867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0da45f-b7d2-4114-8435-c9364e7ddcb7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.072396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:28.072785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 48/88] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:28.074869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0da45f-b7d2-4114-8435-c9364e7ddcb7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:28.086853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d55ce-cedb-4c33-9aad-b2a7d07a44b1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.122116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ea33d-50fb-42f9-875c-75f8a91149fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.122975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea33d-50fb-42f9-875c-75f8a91149fe None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.123257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea33d-50fb-42f9-875c-75f8a91149fe None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.123532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea33d-50fb-42f9-875c-75f8a91149fe None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.124728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ea33d-50fb-42f9-875c-75f8a91149fe None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.126203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ea33d-50fb-42f9-875c-75f8a91149fe None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.127898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 41/89] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:27 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:28.128647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ea33d-50fb-42f9-875c-75f8a91149fe None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:28.176624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0da45f-b7d2-4114-8435-c9364e7ddcb7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.203046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:28.210576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.212652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.212652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.212652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.213186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] RBAC: Adding query filter params (role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0, user.id=f9a9404845604b45b51c1b5c3c8f05b4) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:28.213500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.214951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.220337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 49/90] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:28 2022] GET /identity/v3/role_assignments?user.id=f9a9404845604b45b51c1b5c3c8f05b4&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:28.221111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:28.228960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ea33d-50fb-42f9-875c-75f8a91149fe None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.267393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a5bb-0f5d-4760-8881-39ebf801aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.268327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a5bb-0f5d-4760-8881-39ebf801aba5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.268604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a5bb-0f5d-4760-8881-39ebf801aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.268929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a5bb-0f5d-4760-8881-39ebf801aba5 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.270181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524a5bb-0f5d-4760-8881-39ebf801aba5 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.271646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524a5bb-0f5d-4760-8881-39ebf801aba5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.273454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 42/91] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:28 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:28.273454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a5bb-0f5d-4760-8881-39ebf801aba5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:28.304167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:28.340636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c415839-94d3-46e8-88b0-1d4e2c897ca0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.378823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8a81d-4aba-4c2f-aa04-008523141d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.379479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8a81d-4aba-4c2f-aa04-008523141d03 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.379761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8a81d-4aba-4c2f-aa04-008523141d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.380040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8a81d-4aba-4c2f-aa04-008523141d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.393857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a5bb-0f5d-4760-8881-39ebf801aba5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.433634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d269-1f3e-4c2b-8195-3bf139bddef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.434360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d269-1f3e-4c2b-8195-3bf139bddef4 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.434642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d269-1f3e-4c2b-8195-3bf139bddef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.434915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d269-1f3e-4c2b-8195-3bf139bddef4 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.435616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d269-1f3e-4c2b-8195-3bf139bddef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.437067 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d269-1f3e-4c2b-8195-3bf139bddef4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.449502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:28.458963 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8a81d-4aba-4c2f-aa04-008523141d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.460416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8a81d-4aba-4c2f-aa04-008523141d03 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.558042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 43/92] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:22:28 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:28.558042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d269-1f3e-4c2b-8195-3bf139bddef4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:28.582479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 50/93] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:28.583541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8a81d-4aba-4c2f-aa04-008523141d03 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:28.679114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:28.693043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:28.702756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8a81d-4aba-4c2f-aa04-008523141d03 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.709157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d269-1f3e-4c2b-8195-3bf139bddef4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.749793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.750763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.751241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.751581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.752499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0, user.id=45cbea53fb4d428dbebc3700d01065fb) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:28.758172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.758315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.758391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.758391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.758391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.758589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.758657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] RBAC: Adding query filter params (role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0, user.id=f9a9404845604b45b51c1b5c3c8f05b4) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:28.758657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.758657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.762811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 51/94] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:28 2022] GET /identity/v3/role_assignments?user.id=45cbea53fb4d428dbebc3700d01065fb&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=fe643140d2134736a54afd972d47d43f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:28.763756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:28.765264 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 44/95] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:28 2022] GET /identity/v3/role_assignments?user.id=f9a9404845604b45b51c1b5c3c8f05b4&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:28.894832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4ca8-51d6-4cb9-a2c9-169203b1991c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:28.939605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79d507-78da-4c9f-a89c-96249453d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:28.940479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d507-78da-4c9f-a89c-96249453d9bc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:28.940773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d507-78da-4c9f-a89c-96249453d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:28.941052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d507-78da-4c9f-a89c-96249453d9bc None admin] PATH_INFO: `/v3/projects/565e1a8b9de14089bb47a45102841158` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:28.942433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79d507-78da-4c9f-a89c-96249453d9bc None admin] RBAC: Authorizing `identity:get_project(project_id=565e1a8b9de14089bb47a45102841158)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:28.944233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79d507-78da-4c9f-a89c-96249453d9bc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:28.946934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 52/96] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:28 2022] GET /identity/v3/projects/565e1a8b9de14089bb47a45102841158 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:28.955207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:29.089444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b171c00-be16-442b-b4d4-c0d4e5ae513a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:29.184364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f62a5-48c9-4489-9596-37e714862d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:29.185898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f62a5-48c9-4489-9596-37e714862d02 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:29.186677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f62a5-48c9-4489-9596-37e714862d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:29.187432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f62a5-48c9-4489-9596-37e714862d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:29.189315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f62a5-48c9-4489-9596-37e714862d02 None admin] RBAC: Adding query filter params (role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=565e1a8b9de14089bb47a45102841158, user.id=f9a9404845604b45b51c1b5c3c8f05b4) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:29.190062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f62a5-48c9-4489-9596-37e714862d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:29.192549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f62a5-48c9-4489-9596-37e714862d02 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:29.201027 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 45/97] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:28 2022] GET /identity/v3/role_assignments?user.id=f9a9404845604b45b51c1b5c3c8f05b4&scope.project.id=565e1a8b9de14089bb47a45102841158&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:31.013717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff47ab-28eb-494e-9c9e-383a645f22a6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:31.014669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff47ab-28eb-494e-9c9e-383a645f22a6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:31.015163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff47ab-28eb-494e-9c9e-383a645f22a6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:31.016745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 53/98] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:31.025952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e55a2-6c26-4df7-a8b7-666c8d7d969a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:31.026810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e55a2-6c26-4df7-a8b7-666c8d7d969a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:31.027270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e55a2-6c26-4df7-a8b7-666c8d7d969a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:31.043188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:31.054453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-da5e55a2-6c26-4df7-a8b7-666c8d7d969a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:31.056470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-da5e55a2-6c26-4df7-a8b7-666c8d7d969a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:31.148831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 46/99] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:31.190549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff47ab-28eb-494e-9c9e-383a645f22a6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:31.225476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:31.335329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff47ab-28eb-494e-9c9e-383a645f22a6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:31.380836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625765c-2694-4561-9322-2a7ea4eb33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:31.381639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625765c-2694-4561-9322-2a7ea4eb33f0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:31.381926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625765c-2694-4561-9322-2a7ea4eb33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:31.382244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625765c-2694-4561-9322-2a7ea4eb33f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:31.402975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625765c-2694-4561-9322-2a7ea4eb33f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a625765c-2694-4561-9322-2a7ea4eb33f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:31.411085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:31.411950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:31.412729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 54/100] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:31.420036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e55a2-6c26-4df7-a8b7-666c8d7d969a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:31.548075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e55a2-6c26-4df7-a8b7-666c8d7d969a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:31.592872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:31.593465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:31.593751 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:31.594049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:31.594892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:31.595204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:31.596598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:31.599025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:31.609541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 47/101] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:31.615141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625765c-2694-4561-9322-2a7ea4eb33f0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:31.725311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:31.745153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625765c-2694-4561-9322-2a7ea4eb33f0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:31.804669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3541a-dba7-4d7a-9455-0462b5e062c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:31.806285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3541a-dba7-4d7a-9455-0462b5e062c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:31.806811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3541a-dba7-4d7a-9455-0462b5e062c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:31.807329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3541a-dba7-4d7a-9455-0462b5e062c3 None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:31.809807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3541a-dba7-4d7a-9455-0462b5e062c3 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:31.811772 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3541a-dba7-4d7a-9455-0462b5e062c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:31.813831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 55/102] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:31 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:31.819470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:31.949438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc3366-1148-4870-af74-3635d890b430 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:31.993684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e2aab-6162-4886-8369-42a717d979b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:31.994626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2aab-6162-4886-8369-42a717d979b8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:31.994915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2aab-6162-4886-8369-42a717d979b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:31.995193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e2aab-6162-4886-8369-42a717d979b8 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:31.996563 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e2aab-6162-4886-8369-42a717d979b8 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:31.998098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e2aab-6162-4886-8369-42a717d979b8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:31.999938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 48/103] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:31 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:32.005986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3541a-dba7-4d7a-9455-0462b5e062c3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:32.173228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3541a-dba7-4d7a-9455-0462b5e062c3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:32.221173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb096d6-abfd-4e89-bbb8-5447397fe1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:32.221985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb096d6-abfd-4e89-bbb8-5447397fe1c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.222301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb096d6-abfd-4e89-bbb8-5447397fe1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.222584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb096d6-abfd-4e89-bbb8-5447397fe1c3 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/users/f9a9404845604b45b51c1b5c3c8f05b4/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.227318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb096d6-abfd-4e89-bbb8-5447397fe1c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=66c5167fdf934ea19beeb2cb57b129e0, user_id=f9a9404845604b45b51c1b5c3c8f05b4, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:32.229786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb096d6-abfd-4e89-bbb8-5447397fe1c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:32.286181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2fc78-0407-4e5d-b61f-a5979913b0f9 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.286718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2fc78-0407-4e5d-b61f-a5979913b0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.286795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2fc78-0407-4e5d-b61f-a5979913b0f9 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.288267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 49/104] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:32.298837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17968-9690-4369-9385-2411a28469da None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.299132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17968-9690-4369-9385-2411a28469da None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.299417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b17968-9690-4369-9385-2411a28469da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.316794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 56/105] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:32 2022] PUT /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/users/f9a9404845604b45b51c1b5c3c8f05b4/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:22:32.329190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-63b17968-9690-4369-9385-2411a28469da None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:32.330562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-63b17968-9690-4369-9385-2411a28469da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:32.390586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55137-8499-411b-b1da-df984451ce28 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.391268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55137-8499-411b-b1da-df984451ce28 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.391751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd55137-8499-411b-b1da-df984451ce28 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.393739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 57/106] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:32.399309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96984b03-51a6-47e0-b893-21e8a0035731 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.400585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96984b03-51a6-47e0-b893-21e8a0035731 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.401185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96984b03-51a6-47e0-b893-21e8a0035731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.425028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:32.428535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 50/107] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:32.428655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-96984b03-51a6-47e0-b893-21e8a0035731 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:32.429849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-96984b03-51a6-47e0-b893-21e8a0035731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:32.430485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e55a2c-b2af-4fb3-b14d-d8828729c96f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.431611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e55a2c-b2af-4fb3-b14d-d8828729c96f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.432270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e55a2c-b2af-4fb3-b14d-d8828729c96f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.434322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 51/108] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:32.444513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6d44-dbe2-4be3-afcb-061e1cb87e06 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.445082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6d44-dbe2-4be3-afcb-061e1cb87e06 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.445566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6d44-dbe2-4be3-afcb-061e1cb87e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.449042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:32.483336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d68f6d44-dbe2-4be3-afcb-061e1cb87e06 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:32.484629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d68f6d44-dbe2-4be3-afcb-061e1cb87e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:32.569548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 58/109] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:32.572830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96984b03-51a6-47e0-b893-21e8a0035731 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:32.591304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 52/110] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 18 22:22:32.593002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b3626-add0-4fd3-816f-8fdcf90f4a9a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.593543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b3626-add0-4fd3-816f-8fdcf90f4a9a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.594040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b3626-add0-4fd3-816f-8fdcf90f4a9a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.595592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 53/111] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:32.600863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705d451-2635-4aac-93bf-1c9bd7daf20d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.601507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705d451-2635-4aac-93bf-1c9bd7daf20d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.601989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705d451-2635-4aac-93bf-1c9bd7daf20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.625782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8705d451-2635-4aac-93bf-1c9bd7daf20d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:32.627035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8705d451-2635-4aac-93bf-1c9bd7daf20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:32.710744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96984b03-51a6-47e0-b893-21e8a0035731 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:32.715317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 54/112] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:32.716180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705d451-2635-4aac-93bf-1c9bd7daf20d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:32.770446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d15719-4ee9-47d9-8264-b30176312ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:32.771216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d15719-4ee9-47d9-8264-b30176312ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.771505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d15719-4ee9-47d9-8264-b30176312ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.771778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d15719-4ee9-47d9-8264-b30176312ac4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.784519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d15719-4ee9-47d9-8264-b30176312ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d2d15719-4ee9-47d9-8264-b30176312ac4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:32.793441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:32.794370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:32.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 59/113] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:32.795817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d15719-4ee9-47d9-8264-b30176312ac4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:32.798391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:32.818646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:32.831358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705d451-2635-4aac-93bf-1c9bd7daf20d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:32.870407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a945f35-7350-4b6d-938f-c68405c6255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:32.871205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a945f35-7350-4b6d-938f-c68405c6255a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.871495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a945f35-7350-4b6d-938f-c68405c6255a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.871771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a945f35-7350-4b6d-938f-c68405c6255a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.883326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a945f35-7350-4b6d-938f-c68405c6255a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-2a945f35-7350-4b6d-938f-c68405c6255a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:32.891784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:32.892661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 55/114] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:32.898574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a945f35-7350-4b6d-938f-c68405c6255a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:32.913777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d15719-4ee9-47d9-8264-b30176312ac4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:32.948614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2cf7c-a1df-4ab6-8802-9b3a4b449dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:32.949436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2cf7c-a1df-4ab6-8802-9b3a4b449dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:32.949723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2cf7c-a1df-4ab6-8802-9b3a4b449dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:32.950020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2cf7c-a1df-4ab6-8802-9b3a4b449dd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:32.960310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2cf7c-a1df-4ab6-8802-9b3a4b449dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b6e2cf7c-a1df-4ab6-8802-9b3a4b449dd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:32.968543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:32.969436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:32.970259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 60/115] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:22:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:32.970920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2cf7c-a1df-4ab6-8802-9b3a4b449dd0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.007737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a945f35-7350-4b6d-938f-c68405c6255a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.026730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:33.036170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:33.045356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3527760-178c-4fa6-adf6-c95fb63cc7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.046188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527760-178c-4fa6-adf6-c95fb63cc7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.046472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527760-178c-4fa6-adf6-c95fb63cc7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.046916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527760-178c-4fa6-adf6-c95fb63cc7c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.048052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3527760-178c-4fa6-adf6-c95fb63cc7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:33.049775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3527760-178c-4fa6-adf6-c95fb63cc7c1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:33.051397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 56/116] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:33.052649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d7ec6-7225-4ee4-9e8c-7ef12d5f2c87 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.052941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d7ec6-7225-4ee4-9e8c-7ef12d5f2c87 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.053218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d7ec6-7225-4ee4-9e8c-7ef12d5f2c87 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.058508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 57/117] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:33.058791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d7ec6-7225-4ee4-9e8c-7ef12d5f2c87 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.086787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2cf7c-a1df-4ab6-8802-9b3a4b449dd0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.127187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.127845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.128137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.128421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.129172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:33.129484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:33.130896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:33.139307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 61/118] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:33.144693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.179711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d7ec6-7225-4ee4-9e8c-7ef12d5f2c87 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.215996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.216693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.216979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.217255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.218033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:33.218347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:33.219765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:33.229423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 58/119] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:33.230320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.262930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c59b35-f419-4c17-9a2f-f52db7bcc8fa None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.279295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:33.288849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:33.300371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e79b3-4978-4e79-b5ab-de76c11380d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.301035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e79b3-4978-4e79-b5ab-de76c11380d3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.301441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e79b3-4978-4e79-b5ab-de76c11380d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.301726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e79b3-4978-4e79-b5ab-de76c11380d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.302501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e79b3-4978-4e79-b5ab-de76c11380d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:33.303998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e79b3-4978-4e79-b5ab-de76c11380d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:33.304167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e79b3-4978-4e79-b5ab-de76c11380d3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:33.317407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 62/120] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:22:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:33.317407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa56b-e792-48aa-a20f-a42fb0813493 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.317407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa56b-e792-48aa-a20f-a42fb0813493 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.317407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa56b-e792-48aa-a20f-a42fb0813493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.332339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c14aa56b-e792-48aa-a20f-a42fb0813493 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:33.333640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c14aa56b-e792-48aa-a20f-a42fb0813493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:33.343591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39376732-0059-44ed-a8be-698dac0f224f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.380513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2cce2-abe9-40af-88cf-fd2162a11527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.381170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2cce2-abe9-40af-88cf-fd2162a11527 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.381454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2cce2-abe9-40af-88cf-fd2162a11527 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.381756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2cce2-abe9-40af-88cf-fd2162a11527 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.382483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2cce2-abe9-40af-88cf-fd2162a11527 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:33.384469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2cce2-abe9-40af-88cf-fd2162a11527 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:33.403874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 63/121] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:33.406901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa56b-e792-48aa-a20f-a42fb0813493 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.467284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 59/122] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:22:33 2022] POST /identity/v3/projects => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:33.468502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2cce2-abe9-40af-88cf-fd2162a11527 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.539463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa56b-e792-48aa-a20f-a42fb0813493 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.564157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:33.586802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0299be-a7cb-4a8c-b695-3972842e8510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.588944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0299be-a7cb-4a8c-b695-3972842e8510 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.589436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0299be-a7cb-4a8c-b695-3972842e8510 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.589914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0299be-a7cb-4a8c-b695-3972842e8510 None admin] PATH_INFO: `/v3/users/80ed1ab312494a05b50dd11198efaa3a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.595335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:33.600869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2cce2-abe9-40af-88cf-fd2162a11527 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.615022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0299be-a7cb-4a8c-b695-3972842e8510 None admin] RBAC: Authorizing `identity:get_user(user_id=80ed1ab312494a05b50dd11198efaa3a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:33.617123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0299be-a7cb-4a8c-b695-3972842e8510 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:33.620398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 64/123] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:33 2022] GET /identity/v3/users/80ed1ab312494a05b50dd11198efaa3a => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:33.624412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0299be-a7cb-4a8c-b695-3972842e8510 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.647932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709c512-5553-46c0-9846-2fe7f88468db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.648886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709c512-5553-46c0-9846-2fe7f88468db None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.649219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709c512-5553-46c0-9846-2fe7f88468db None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.650297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709c512-5553-46c0-9846-2fe7f88468db None admin] PATH_INFO: `/v3/users/45cbea53fb4d428dbebc3700d01065fb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.652070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709c512-5553-46c0-9846-2fe7f88468db None admin] RBAC: Authorizing `identity:get_user(user_id=45cbea53fb4d428dbebc3700d01065fb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:33.653649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709c512-5553-46c0-9846-2fe7f88468db None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:33.660428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 60/124] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:33 2022] GET /identity/v3/users/45cbea53fb4d428dbebc3700d01065fb => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:33.660428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709c512-5553-46c0-9846-2fe7f88468db None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.764065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0299be-a7cb-4a8c-b695-3972842e8510 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.783964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709c512-5553-46c0-9846-2fe7f88468db None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.807420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ced8-77dc-4717-9aec-c7508e5337fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.808231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ced8-77dc-4717-9aec-c7508e5337fc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.808515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ced8-77dc-4717-9aec-c7508e5337fc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.808795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ced8-77dc-4717-9aec-c7508e5337fc None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.810253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ced8-77dc-4717-9aec-c7508e5337fc None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:33.812778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ced8-77dc-4717-9aec-c7508e5337fc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:33.815524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 65/125] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:33 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:33.816311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ced8-77dc-4717-9aec-c7508e5337fc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.828560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40645861-4156-4230-80c2-6904ef667be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.829557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40645861-4156-4230-80c2-6904ef667be1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.829918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40645861-4156-4230-80c2-6904ef667be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.830287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40645861-4156-4230-80c2-6904ef667be1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.842703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40645861-4156-4230-80c2-6904ef667be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-40645861-4156-4230-80c2-6904ef667be1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:33.851489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:33.852545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:33.854069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:33.854801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 61/126] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:33.858106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40645861-4156-4230-80c2-6904ef667be1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:33.874051 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:33.893978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:33.936821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ced8-77dc-4717-9aec-c7508e5337fc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:33.977458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e206e3-1d2c-4b56-9c7c-55f6d0912dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:33.978313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e206e3-1d2c-4b56-9c7c-55f6d0912dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:33.978695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e206e3-1d2c-4b56-9c7c-55f6d0912dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:33.979051 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e206e3-1d2c-4b56-9c7c-55f6d0912dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:33.983488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40645861-4156-4230-80c2-6904ef667be1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:34.020785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84189c77-c500-45e7-bdba-9feb60508315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:34.022398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84189c77-c500-45e7-bdba-9feb60508315 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.022888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84189c77-c500-45e7-bdba-9feb60508315 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.023345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84189c77-c500-45e7-bdba-9feb60508315 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.025144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84189c77-c500-45e7-bdba-9feb60508315 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.027498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84189c77-c500-45e7-bdba-9feb60508315 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.029646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 62/127] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:33 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:34.031038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84189c77-c500-45e7-bdba-9feb60508315 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:34.053793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e206e3-1d2c-4b56-9c7c-55f6d0912dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.056234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e206e3-1d2c-4b56-9c7c-55f6d0912dd8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.153026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:34.172651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:34.179812 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84189c77-c500-45e7-bdba-9feb60508315 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:34.214518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 66/128] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:34.215761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e206e3-1d2c-4b56-9c7c-55f6d0912dd8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:34.223943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c7b05-dd4e-42bc-9610-c3a00f8b59a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:34.225011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c7b05-dd4e-42bc-9610-c3a00f8b59a9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.225208 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c7b05-dd4e-42bc-9610-c3a00f8b59a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.225483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c7b05-dd4e-42bc-9610-c3a00f8b59a9 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.226693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c7b05-dd4e-42bc-9610-c3a00f8b59a9 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.228739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4c7b05-dd4e-42bc-9610-c3a00f8b59a9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.230907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 63/129] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:34 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:34.231784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c7b05-dd4e-42bc-9610-c3a00f8b59a9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:34.322496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e206e3-1d2c-4b56-9c7c-55f6d0912dd8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:34.363131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c7b05-dd4e-42bc-9610-c3a00f8b59a9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:34.365311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:34.366146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.366661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.367011 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.367888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:34.368282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.369859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.383430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 67/130] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:34.383430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:34.388125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:34.408018 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949673-ecd0-47d9-86e7-f9b3ffdf3656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:34.408966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949673-ecd0-47d9-86e7-f9b3ffdf3656 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.409244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949673-ecd0-47d9-86e7-f9b3ffdf3656 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.409519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27949673-ecd0-47d9-86e7-f9b3ffdf3656 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/users/45cbea53fb4d428dbebc3700d01065fb/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.411736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27949673-ecd0-47d9-86e7-f9b3ffdf3656 None admin] RBAC: Authorizing `identity:create_grant(project_id=66c5167fdf934ea19beeb2cb57b129e0, user_id=45cbea53fb4d428dbebc3700d01065fb, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.413195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27949673-ecd0-47d9-86e7-f9b3ffdf3656 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.490920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076a462-43ca-4708-8d44-e7381900130e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:34.506970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 64/131] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:34 2022] PUT /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/users/45cbea53fb4d428dbebc3700d01065fb/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:22:34.515150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949673-ecd0-47d9-86e7-f9b3ffdf3656 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:34.567400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4225a-e644-46f0-a5eb-f5ff53d002b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:34.572075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4225a-e644-46f0-a5eb-f5ff53d002b0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.572913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4225a-e644-46f0-a5eb-f5ff53d002b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.573419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4225a-e644-46f0-a5eb-f5ff53d002b0 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.576432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4225a-e644-46f0-a5eb-f5ff53d002b0 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.579952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4225a-e644-46f0-a5eb-f5ff53d002b0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.582713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:34.593022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 68/132] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:34 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:34.601580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4225a-e644-46f0-a5eb-f5ff53d002b0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:34.680444 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:34.715300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4225a-e644-46f0-a5eb-f5ff53d002b0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:34.754983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d860f5-e5e1-4937-9cdd-cb7a03558f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:34.756281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d860f5-e5e1-4937-9cdd-cb7a03558f35 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.756756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d860f5-e5e1-4937-9cdd-cb7a03558f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.757256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d860f5-e5e1-4937-9cdd-cb7a03558f35 None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.758784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d860f5-e5e1-4937-9cdd-cb7a03558f35 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.760647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d860f5-e5e1-4937-9cdd-cb7a03558f35 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.762607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 69/133] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:34 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:34.763805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d860f5-e5e1-4937-9cdd-cb7a03558f35 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:34.780043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27949673-ecd0-47d9-86e7-f9b3ffdf3656 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:34.833758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec66dc5-923c-4d63-9425-20e5aa270e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:34.834739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66dc5-923c-4d63-9425-20e5aa270e01 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.835022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66dc5-923c-4d63-9425-20e5aa270e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.835312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66dc5-923c-4d63-9425-20e5aa270e01 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/users/f9a9404845604b45b51c1b5c3c8f05b4/roles/6fa4573097ea4494b215fa0be868f8cd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.838238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec66dc5-923c-4d63-9425-20e5aa270e01 None admin] RBAC: Authorizing `identity:create_grant(project_id=66c5167fdf934ea19beeb2cb57b129e0, user_id=f9a9404845604b45b51c1b5c3c8f05b4, role_id=6fa4573097ea4494b215fa0be868f8cd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.839841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec66dc5-923c-4d63-9425-20e5aa270e01 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.880618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d860f5-e5e1-4937-9cdd-cb7a03558f35 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:34.917188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beec12f-7f76-4e57-baa4-cdc647646789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:34.917847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec12f-7f76-4e57-baa4-cdc647646789 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.918177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec12f-7f76-4e57-baa4-cdc647646789 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.918453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beec12f-7f76-4e57-baa4-cdc647646789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.919330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beec12f-7f76-4e57-baa4-cdc647646789 None admin] RBAC: Adding query filter params (role.id=e1b545f08a884bf4b8bd6526ad868009, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0, user.id=80ed1ab312494a05b50dd11198efaa3a) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:34.919668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beec12f-7f76-4e57-baa4-cdc647646789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:34.920419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 65/134] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:34 2022] PUT /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/users/f9a9404845604b45b51c1b5c3c8f05b4/roles/6fa4573097ea4494b215fa0be868f8cd => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:22:34.926291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec66dc5-923c-4d63-9425-20e5aa270e01 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:34.926462 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beec12f-7f76-4e57-baa4-cdc647646789 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:34.933028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 70/135] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:34 2022] GET /identity/v3/role_assignments?user.id=80ed1ab312494a05b50dd11198efaa3a&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=e1b545f08a884bf4b8bd6526ad868009 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:34.934593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfad2fb-3f3a-413c-88d0-294da8f2f46e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.934937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfad2fb-3f3a-413c-88d0-294da8f2f46e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.935298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfad2fb-3f3a-413c-88d0-294da8f2f46e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.936777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 71/136] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:34.950059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff5bd-51f0-412e-8b85-b2cbe61911ca None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:34.950413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff5bd-51f0-412e-8b85-b2cbe61911ca None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:34.950682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaff5bd-51f0-412e-8b85-b2cbe61911ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:34.964062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:34.984760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0aaff5bd-51f0-412e-8b85-b2cbe61911ca None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:34.985964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0aaff5bd-51f0-412e-8b85-b2cbe61911ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:35.128224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:35.140469 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 72/137] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:35.153500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec66dc5-923c-4d63-9425-20e5aa270e01 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:35.187977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaff5bd-51f0-412e-8b85-b2cbe61911ca None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:35.198752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73778d1f-0719-46f3-bd11-6cfdf9ea8114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:35.199644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778d1f-0719-46f3-bd11-6cfdf9ea8114 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:35.199928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778d1f-0719-46f3-bd11-6cfdf9ea8114 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:35.200204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73778d1f-0719-46f3-bd11-6cfdf9ea8114 None admin] PATH_INFO: `/v3/projects/565e1a8b9de14089bb47a45102841158` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:35.206159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73778d1f-0719-46f3-bd11-6cfdf9ea8114 None admin] RBAC: Authorizing `identity:get_project(project_id=565e1a8b9de14089bb47a45102841158)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:35.207175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73778d1f-0719-46f3-bd11-6cfdf9ea8114 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:35.208983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 66/138] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:34 2022] GET /identity/v3/projects/565e1a8b9de14089bb47a45102841158 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:35.215219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73778d1f-0719-46f3-bd11-6cfdf9ea8114 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:35.372541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaff5bd-51f0-412e-8b85-b2cbe61911ca None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:35.393310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73778d1f-0719-46f3-bd11-6cfdf9ea8114 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:35.413450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5c2a8-780b-48cc-995b-abfec3f32b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:35.414289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c2a8-780b-48cc-995b-abfec3f32b3e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:35.416662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c2a8-780b-48cc-995b-abfec3f32b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:35.416877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5c2a8-780b-48cc-995b-abfec3f32b3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:35.421253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:35.440098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5c2a8-780b-48cc-995b-abfec3f32b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6ab5c2a8-780b-48cc-995b-abfec3f32b3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:35.451546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:35.452457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:35.453681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 73/139] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:35.459193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5c2a8-780b-48cc-995b-abfec3f32b3e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:35.475668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51af8d-ea5c-432d-b335-575e9956e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:35.476911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51af8d-ea5c-432d-b335-575e9956e6c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:35.477259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51af8d-ea5c-432d-b335-575e9956e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:35.478197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51af8d-ea5c-432d-b335-575e9956e6c2 None admin] PATH_INFO: `/v3/projects/565e1a8b9de14089bb47a45102841158/users/f9a9404845604b45b51c1b5c3c8f05b4/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:35.483421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51af8d-ea5c-432d-b335-575e9956e6c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=565e1a8b9de14089bb47a45102841158, user_id=f9a9404845604b45b51c1b5c3c8f05b4, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:35.484960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51af8d-ea5c-432d-b335-575e9956e6c2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:35.568655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 67/140] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:35 2022] PUT /identity/v3/projects/565e1a8b9de14089bb47a45102841158/users/f9a9404845604b45b51c1b5c3c8f05b4/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:22:35.579830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5c2a8-780b-48cc-995b-abfec3f32b3e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:35.626565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:35.627589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:35.628050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:35.628543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:35.629514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:35.630080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:35.631763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:35.646440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 74/141] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:35.652644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51af8d-ea5c-432d-b335-575e9956e6c2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:35.680132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:35.815265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51af8d-ea5c-432d-b335-575e9956e6c2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:35.867958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210fa6-e8ec-4c0d-9f1e-cbbe4cc411d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:35.869767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210fa6-e8ec-4c0d-9f1e-cbbe4cc411d7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:35.870121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210fa6-e8ec-4c0d-9f1e-cbbe4cc411d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:35.870404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210fa6-e8ec-4c0d-9f1e-cbbe4cc411d7 None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:35.871681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4210fa6-e8ec-4c0d-9f1e-cbbe4cc411d7 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:35.873150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4210fa6-e8ec-4c0d-9f1e-cbbe4cc411d7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:35.875152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 68/142] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:35 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:35.880687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:36.007338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:36.066174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d8fc4-873a-4ad0-8352-1ae8ca06479f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:36.109500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93805-1556-43cd-8a41-2cfc91930237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:36.110199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93805-1556-43cd-8a41-2cfc91930237 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:36.110483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93805-1556-43cd-8a41-2cfc91930237 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:36.110758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e93805-1556-43cd-8a41-2cfc91930237 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:36.158713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d155-a60f-4deb-9e25-5aca9c5fe8ac None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:36.159008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d155-a60f-4deb-9e25-5aca9c5fe8ac None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:36.159272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d155-a60f-4deb-9e25-5aca9c5fe8ac None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:36.160772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 69/143] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:22:36.166334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436edb-e463-4937-9972-20a4e0ea4028 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:36.166671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436edb-e463-4937-9972-20a4e0ea4028 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:36.166968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55436edb-e463-4937-9972-20a4e0ea4028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:36.189890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-55436edb-e463-4937-9972-20a4e0ea4028 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:36.191108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-55436edb-e463-4937-9972-20a4e0ea4028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:36.238200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e93805-1556-43cd-8a41-2cfc91930237 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:36.239685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e93805-1556-43cd-8a41-2cfc91930237 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:36.318858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 70/144] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:36.340585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:36.359375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55436edb-e463-4937-9972-20a4e0ea4028 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:36.371218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:36.459521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 75/145] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:36.465678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93805-1556-43cd-8a41-2cfc91930237 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:36.549760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55436edb-e463-4937-9972-20a4e0ea4028 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:36.587448 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc965-381c-4710-906d-c693bc9414f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:36.588418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc965-381c-4710-906d-c693bc9414f2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:36.588703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc965-381c-4710-906d-c693bc9414f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:36.588979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbc965-381c-4710-906d-c693bc9414f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:36.590199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc965-381c-4710-906d-c693bc9414f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:36.591675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbc965-381c-4710-906d-c693bc9414f2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:36.593523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 71/146] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:36.598633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc965-381c-4710-906d-c693bc9414f2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:36.653627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e93805-1556-43cd-8a41-2cfc91930237 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:36.684460 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:36.708158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbc965-381c-4710-906d-c693bc9414f2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:36.725249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a368-6df0-4e85-8dbe-da0612464b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:36.726151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a368-6df0-4e85-8dbe-da0612464b78 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:36.726440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a368-6df0-4e85-8dbe-da0612464b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:36.726720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a368-6df0-4e85-8dbe-da0612464b78 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:36.730764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a368-6df0-4e85-8dbe-da0612464b78 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:36.732230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a368-6df0-4e85-8dbe-da0612464b78 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:36.734299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 76/147] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:36 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:36.743698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a368-6df0-4e85-8dbe-da0612464b78 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:36.746256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81680fa-abc1-4aaa-bc5e-79423c48537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:36.747002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81680fa-abc1-4aaa-bc5e-79423c48537d None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:36.747363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81680fa-abc1-4aaa-bc5e-79423c48537d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:36.747707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81680fa-abc1-4aaa-bc5e-79423c48537d None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:36.748489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81680fa-abc1-4aaa-bc5e-79423c48537d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:36.750037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81680fa-abc1-4aaa-bc5e-79423c48537d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:36.780906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:36.836525 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 72/148] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:22:36 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:22:36.875329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a368-6df0-4e85-8dbe-da0612464b78 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:36.926232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b5e96-39fe-4076-a443-3658d2848e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:36.927135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b5e96-39fe-4076-a443-3658d2848e2b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:36.927556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b5e96-39fe-4076-a443-3658d2848e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:36.927972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b5e96-39fe-4076-a443-3658d2848e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:36.928950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b5e96-39fe-4076-a443-3658d2848e2b None admin] RBAC: Adding query filter params (role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0, user.id=f9a9404845604b45b51c1b5c3c8f05b4) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:36.929426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b5e96-39fe-4076-a443-3658d2848e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:36.931172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b5e96-39fe-4076-a443-3658d2848e2b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:36.938485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 77/149] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:36 2022] GET /identity/v3/role_assignments?user.id=f9a9404845604b45b51c1b5c3c8f05b4&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:37.387504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07704-a849-40fd-8687-88f67ca7137c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:37.388101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07704-a849-40fd-8687-88f67ca7137c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:37.388488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f07704-a849-40fd-8687-88f67ca7137c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:37.389947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 73/150] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:37.395265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053eba9-e3c4-482f-8f00-e14eac78c6ff None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:37.395555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053eba9-e3c4-482f-8f00-e14eac78c6ff None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:37.395827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053eba9-e3c4-482f-8f00-e14eac78c6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:37.413537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a053eba9-e3c4-482f-8f00-e14eac78c6ff None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:37.414873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a053eba9-e3c4-482f-8f00-e14eac78c6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:37.497625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 78/151] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:37.522559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f07704-a849-40fd-8687-88f67ca7137c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:37.652611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f07704-a849-40fd-8687-88f67ca7137c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:37.688371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:37.693058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d98265-1fc4-4498-aa2d-75cc115f5bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:37.694204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98265-1fc4-4498-aa2d-75cc115f5bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:37.694489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98265-1fc4-4498-aa2d-75cc115f5bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:37.694767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98265-1fc4-4498-aa2d-75cc115f5bd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:37.706173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d98265-1fc4-4498-aa2d-75cc115f5bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b1d98265-1fc4-4498-aa2d-75cc115f5bd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:37.716236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:37.717166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:37.718218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 74/152] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:37.723828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053eba9-e3c4-482f-8f00-e14eac78c6ff None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:37.747512 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:37.840203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053eba9-e3c4-482f-8f00-e14eac78c6ff None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:37.878440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:37.879112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:37.879393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:37.879666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:37.880430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:37.880738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:37.882144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:37.891955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 79/153] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:37.897609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d98265-1fc4-4498-aa2d-75cc115f5bd4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:38.005472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d98265-1fc4-4498-aa2d-75cc115f5bd4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:38.041694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7954-6257-4005-b082-f96665d0d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:38.042618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7954-6257-4005-b082-f96665d0d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.042895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7954-6257-4005-b082-f96665d0d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.043169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7954-6257-4005-b082-f96665d0d6c6 None admin] PATH_INFO: `/v3/users/45cbea53fb4d428dbebc3700d01065fb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.044389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b7954-6257-4005-b082-f96665d0d6c6 None admin] RBAC: Authorizing `identity:get_user(user_id=45cbea53fb4d428dbebc3700d01065fb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:38.045844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b7954-6257-4005-b082-f96665d0d6c6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:38.047792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 75/154] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:37 2022] GET /identity/v3/users/45cbea53fb4d428dbebc3700d01065fb => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:38.053261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:38.165580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:38.189653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e45205-937c-4950-801d-ceb7e443d7cb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:38.245559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c9ec3-dd55-46fd-b103-2dcfd569b189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:38.246604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9ec3-dd55-46fd-b103-2dcfd569b189 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.247096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9ec3-dd55-46fd-b103-2dcfd569b189 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.247732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c9ec3-dd55-46fd-b103-2dcfd569b189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.345001 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c9ec3-dd55-46fd-b103-2dcfd569b189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:38.346450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c9ec3-dd55-46fd-b103-2dcfd569b189 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:38.444079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:38.465606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 80/155] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:38.471060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7954-6257-4005-b082-f96665d0d6c6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:38.518033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89288721-28e9-487a-9e0a-9b3b216bbf38 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.518033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89288721-28e9-487a-9e0a-9b3b216bbf38 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.518033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89288721-28e9-487a-9e0a-9b3b216bbf38 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.519119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 81/156] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:38.527981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a22b7-ea51-4ada-b4a7-3e91f945bb68 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.528265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a22b7-ea51-4ada-b4a7-3e91f945bb68 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.528545 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a22b7-ea51-4ada-b4a7-3e91f945bb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.564877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e91a22b7-ea51-4ada-b4a7-3e91f945bb68 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:38.566089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e91a22b7-ea51-4ada-b4a7-3e91f945bb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:38.585393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:38.658358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 82/157] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:38.659700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd706-cab8-45cb-b546-c7f7b6e03d92 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.659986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd706-cab8-45cb-b546-c7f7b6e03d92 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.660260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fd706-cab8-45cb-b546-c7f7b6e03d92 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.661122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7954-6257-4005-b082-f96665d0d6c6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:38.661556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 83/158] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:38.675594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b8de-c6e5-470e-afe5-ecbb6fabec2c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.675877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b8de-c6e5-470e-afe5-ecbb6fabec2c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.676142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b8de-c6e5-470e-afe5-ecbb6fabec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.705593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4473b8de-c6e5-470e-afe5-ecbb6fabec2c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:38.706895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4473b8de-c6e5-470e-afe5-ecbb6fabec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:38.734977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d46468-ddfc-4016-b3b3-92b7dcc944ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:38.736390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d46468-ddfc-4016-b3b3-92b7dcc944ca None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.736862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d46468-ddfc-4016-b3b3-92b7dcc944ca None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.737345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d46468-ddfc-4016-b3b3-92b7dcc944ca None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.738815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d46468-ddfc-4016-b3b3-92b7dcc944ca None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:38.740987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d46468-ddfc-4016-b3b3-92b7dcc944ca None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:38.743768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 76/159] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:38 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:38.744792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d46468-ddfc-4016-b3b3-92b7dcc944ca None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:38.870163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d46468-ddfc-4016-b3b3-92b7dcc944ca None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:38.894440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 84/160] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:38.898353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473b8de-c6e5-470e-afe5-ecbb6fabec2c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:38.918697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:38.942102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed60889-3e54-40e8-8092-213223e03f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:38.951218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60889-3e54-40e8-8092-213223e03f34 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.951218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60889-3e54-40e8-8092-213223e03f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.951218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed60889-3e54-40e8-8092-213223e03f34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.962666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:38.972843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed60889-3e54-40e8-8092-213223e03f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-eed60889-3e54-40e8-8092-213223e03f34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:38.981229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:38.982174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:38.983041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:38.994594 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 77/161] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:38.995969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9578-2b6a-4ab8-b16d-8b35ae709169 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:38.996256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9578-2b6a-4ab8-b16d-8b35ae709169 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:38.996533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea9578-2b6a-4ab8-b16d-8b35ae709169 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:38.998115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 78/162] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:38.998843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea9578-2b6a-4ab8-b16d-8b35ae709169 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:39.060790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473b8de-c6e5-470e-afe5-ecbb6fabec2c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:39.152561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:39.153220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:39.153501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:39.153775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:39.154658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0, user.id=45cbea53fb4d428dbebc3700d01065fb) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:39.154970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:39.156425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:39.172539 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea9578-2b6a-4ab8-b16d-8b35ae709169 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:39.176231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 85/163] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:38 2022] GET /identity/v3/role_assignments?user.id=45cbea53fb4d428dbebc3700d01065fb&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=fe643140d2134736a54afd972d47d43f => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:39.177069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:39.212995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1c2b-e679-43c4-9442-e9b7290ce54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:39.213842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1c2b-e679-43c4-9442-e9b7290ce54c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:39.214151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1c2b-e679-43c4-9442-e9b7290ce54c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:39.214426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1c2b-e679-43c4-9442-e9b7290ce54c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:39.228620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1c2b-e679-43c4-9442-e9b7290ce54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b75c1c2b-e679-43c4-9442-e9b7290ce54c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:39.238272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:39.239224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:39.240505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 79/164] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:22:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:39.241262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ad70-eee6-42cc-be64-c48d3a404ffa None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:39.241554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ad70-eee6-42cc-be64-c48d3a404ffa None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:39.241703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ad70-eee6-42cc-be64-c48d3a404ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:39.262431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b419ad70-eee6-42cc-be64-c48d3a404ffa None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:39.263695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b419ad70-eee6-42cc-be64-c48d3a404ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:39.328391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:39.361299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 80/165] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:39.366852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ad70-eee6-42cc-be64-c48d3a404ffa None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:39.527093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de445127-0248-4fca-b5c8-dcb37a93b161 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:39.538368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:39.560167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ad70-eee6-42cc-be64-c48d3a404ffa None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:39.576111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:39.576789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:39.577071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:39.577347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:39.578177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:39.578484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:39.580396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:39.591408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 86/166] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:39.592270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:39.628737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:39.629822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:39.630136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:39.630657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:39.631425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:39.631881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:39.634561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:39.651530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 81/167] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:22:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:39.654272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:39.747631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:39.775629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7b15c-68ba-450e-a901-c2ccc1f9e681 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:39.847583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91079bb-d619-45a0-a5c0-0d84b7e346f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:39.848309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91079bb-d619-45a0-a5c0-0d84b7e346f8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:39.848594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91079bb-d619-45a0-a5c0-0d84b7e346f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:39.848872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91079bb-d619-45a0-a5c0-0d84b7e346f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:39.858021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebadcfa-f776-4afb-9da3-467447b0af2d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:39.877978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91079bb-d619-45a0-a5c0-0d84b7e346f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b91079bb-d619-45a0-a5c0-0d84b7e346f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:39.894028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:39.894967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:39.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:39.898316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 87/168] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:39.899912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91079bb-d619-45a0-a5c0-0d84b7e346f8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:39.908813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc96ef-20f2-438d-9fa0-18817ad69c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:39.911972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc96ef-20f2-438d-9fa0-18817ad69c63 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:39.912483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc96ef-20f2-438d-9fa0-18817ad69c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:39.912904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc96ef-20f2-438d-9fa0-18817ad69c63 None admin] PATH_INFO: `/v3/users/80ed1ab312494a05b50dd11198efaa3a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:39.914379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc96ef-20f2-438d-9fa0-18817ad69c63 None admin] RBAC: Authorizing `identity:get_user(user_id=80ed1ab312494a05b50dd11198efaa3a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:39.916305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc96ef-20f2-438d-9fa0-18817ad69c63 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:39.918176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 82/169] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:39 2022] GET /identity/v3/users/80ed1ab312494a05b50dd11198efaa3a => generated 289 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:39.919094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc96ef-20f2-438d-9fa0-18817ad69c63 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:39.964162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:40.032595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc96ef-20f2-438d-9fa0-18817ad69c63 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:40.047813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:40.070286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:40.071906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.072396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.072844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.073783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:40.074306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:40.075959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:40.085732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 83/170] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:40.087006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:40.180161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91079bb-d619-45a0-a5c0-0d84b7e346f8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:40.194946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444639d9-1496-4e03-83d9-bb3586793e38 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:40.232684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fff98-f8c4-4df6-90d1-1aa62be8a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:40.233874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fff98-f8c4-4df6-90d1-1aa62be8a4de None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.234477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fff98-f8c4-4df6-90d1-1aa62be8a4de None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.235128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fff98-f8c4-4df6-90d1-1aa62be8a4de None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.236485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fff98-f8c4-4df6-90d1-1aa62be8a4de None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:40.238365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fff98-f8c4-4df6-90d1-1aa62be8a4de None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:40.240484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 84/171] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:40 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:40.241461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fff98-f8c4-4df6-90d1-1aa62be8a4de None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:40.262704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d8f2d-1afb-4e84-a538-fc02207bb339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:40.263595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d8f2d-1afb-4e84-a538-fc02207bb339 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.263880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d8f2d-1afb-4e84-a538-fc02207bb339 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.264160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d8f2d-1afb-4e84-a538-fc02207bb339 None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.270871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d8f2d-1afb-4e84-a538-fc02207bb339 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:40.272268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d8f2d-1afb-4e84-a538-fc02207bb339 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:40.273920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 88/172] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:39 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:40.275495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d8f2d-1afb-4e84-a538-fc02207bb339 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:40.298355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:40.351894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fff98-f8c4-4df6-90d1-1aa62be8a4de None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:40.391776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1bdd3-a2b8-4763-9960-959945996781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:40.392987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1bdd3-a2b8-4763-9960-959945996781 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.393451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1bdd3-a2b8-4763-9960-959945996781 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.393935 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1bdd3-a2b8-4763-9960-959945996781 None admin] PATH_INFO: `/v3/users/f9a9404845604b45b51c1b5c3c8f05b4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.395481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1bdd3-a2b8-4763-9960-959945996781 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a9404845604b45b51c1b5c3c8f05b4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:40.397185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1bdd3-a2b8-4763-9960-959945996781 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:40.399241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 85/173] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:40 2022] GET /identity/v3/users/f9a9404845604b45b51c1b5c3c8f05b4 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:40.400643 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1bdd3-a2b8-4763-9960-959945996781 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:40.458118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:40.469362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d8f2d-1afb-4e84-a538-fc02207bb339 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:40.514611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1bdd3-a2b8-4763-9960-959945996781 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:40.523087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:40.544600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4a1f-3c70-411d-a88d-7b201abfe512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:40.545504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4a1f-3c70-411d-a88d-7b201abfe512 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.545784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4a1f-3c70-411d-a88d-7b201abfe512 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.546088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4a1f-3c70-411d-a88d-7b201abfe512 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/users/80ed1ab312494a05b50dd11198efaa3a/roles/e1b545f08a884bf4b8bd6526ad868009` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.548224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f4a1f-3c70-411d-a88d-7b201abfe512 None admin] RBAC: Authorizing `identity:create_grant(project_id=66c5167fdf934ea19beeb2cb57b129e0, user_id=80ed1ab312494a05b50dd11198efaa3a, role_id=e1b545f08a884bf4b8bd6526ad868009)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:40.549658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f4a1f-3c70-411d-a88d-7b201abfe512 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:40.555362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66cf3-5a82-4bf6-9828-c7be956e9a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:40.556816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66cf3-5a82-4bf6-9828-c7be956e9a4d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.557371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66cf3-5a82-4bf6-9828-c7be956e9a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.557892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66cf3-5a82-4bf6-9828-c7be956e9a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.612203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 89/174] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:40 2022] PUT /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/users/80ed1ab312494a05b50dd11198efaa3a/roles/e1b545f08a884bf4b8bd6526ad868009 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:22:40.613888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4a1f-3c70-411d-a88d-7b201abfe512 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:40.636568 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66cf3-5a82-4bf6-9828-c7be956e9a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:40.638538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66cf3-5a82-4bf6-9828-c7be956e9a4d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:40.755551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 86/175] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:40.760570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66cf3-5a82-4bf6-9828-c7be956e9a4d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:40.772245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:40.793514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4a1f-3c70-411d-a88d-7b201abfe512 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:40.861722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe36898-1a7f-4193-acd6-93c1e0c57bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:40.862401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe36898-1a7f-4193-acd6-93c1e0c57bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.862680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe36898-1a7f-4193-acd6-93c1e0c57bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.862953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe36898-1a7f-4193-acd6-93c1e0c57bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.878081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66cf3-5a82-4bf6-9828-c7be956e9a4d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:40.918593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf231af2-761a-4725-837c-145db9fc664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:40.920010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:40.920812 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231af2-761a-4725-837c-145db9fc664d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.921315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231af2-761a-4725-837c-145db9fc664d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.921822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231af2-761a-4725-837c-145db9fc664d None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.923364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf231af2-761a-4725-837c-145db9fc664d None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:40.925066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf231af2-761a-4725-837c-145db9fc664d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:40.927446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 87/176] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:40 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:40.928963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7153a-8864-4004-ac3c-cfe0c173b33b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:40.929451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7153a-8864-4004-ac3c-cfe0c173b33b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:40.929889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7153a-8864-4004-ac3c-cfe0c173b33b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:40.932804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 88/177] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:40.933694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7153a-8864-4004-ac3c-cfe0c173b33b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:41.001732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe36898-1a7f-4193-acd6-93c1e0c57bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:41.003548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe36898-1a7f-4193-acd6-93c1e0c57bb0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:41.021737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:41.053690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7153a-8864-4004-ac3c-cfe0c173b33b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:41.106795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58de5a-fee6-433e-a77b-9c18c65c83ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:41.107458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58de5a-fee6-433e-a77b-9c18c65c83ac None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.107738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58de5a-fee6-433e-a77b-9c18c65c83ac None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.108336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58de5a-fee6-433e-a77b-9c18c65c83ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.109472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58de5a-fee6-433e-a77b-9c18c65c83ac None admin] RBAC: Adding query filter params (role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0, user.id=f9a9404845604b45b51c1b5c3c8f05b4) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:41.109782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58de5a-fee6-433e-a77b-9c18c65c83ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:41.111522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58de5a-fee6-433e-a77b-9c18c65c83ac None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:41.119858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 89/178] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:40 2022] GET /identity/v3/role_assignments?user.id=f9a9404845604b45b51c1b5c3c8f05b4&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:41.121623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf579e-fb64-4ae3-9f94-9ea77ea29cec None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.122207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf579e-fb64-4ae3-9f94-9ea77ea29cec None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.122483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf579e-fb64-4ae3-9f94-9ea77ea29cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.137047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 90/179] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:41.142942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe36898-1a7f-4193-acd6-93c1e0c57bb0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:41.149293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7ecf579e-fb64-4ae3-9f94-9ea77ea29cec None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:41.151196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7ecf579e-fb64-4ae3-9f94-9ea77ea29cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:41.261830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 90/180] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:41.269044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:41.273604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32162cbe-1b9b-4076-a57e-0f30f227b831 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.273852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32162cbe-1b9b-4076-a57e-0f30f227b831 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.274114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32162cbe-1b9b-4076-a57e-0f30f227b831 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.276228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 91/181] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:41.285388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288c69-b318-482e-80e3-fa1d6612762f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.291748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288c69-b318-482e-80e3-fa1d6612762f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.291748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288c69-b318-482e-80e3-fa1d6612762f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.309577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-17288c69-b318-482e-80e3-fa1d6612762f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:41.311481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-17288c69-b318-482e-80e3-fa1d6612762f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:41.331116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe36898-1a7f-4193-acd6-93c1e0c57bb0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:41.385254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc02e-f14f-4b3f-a364-fd1f3d31ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:41.387332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc02e-f14f-4b3f-a364-fd1f3d31ff39 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.387617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc02e-f14f-4b3f-a364-fd1f3d31ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.387898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc02e-f14f-4b3f-a364-fd1f3d31ff39 None admin] PATH_INFO: `/v3/projects/565e1a8b9de14089bb47a45102841158` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.391053 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc02e-f14f-4b3f-a364-fd1f3d31ff39 None admin] RBAC: Authorizing `identity:get_project(project_id=565e1a8b9de14089bb47a45102841158)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:41.392564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc02e-f14f-4b3f-a364-fd1f3d31ff39 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:41.396642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 91/182] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:41 2022] GET /identity/v3/projects/565e1a8b9de14089bb47a45102841158 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:41.397484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc02e-f14f-4b3f-a364-fd1f3d31ff39 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:41.411153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:41.420940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 92/183] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:41.422135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17288c69-b318-482e-80e3-fa1d6612762f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:41.532612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc02e-f14f-4b3f-a364-fd1f3d31ff39 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:41.543840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17288c69-b318-482e-80e3-fa1d6612762f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:41.557415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:41.569530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff8d3f-7232-406a-98c9-dc44d94477bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:41.574495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8d3f-7232-406a-98c9-dc44d94477bb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.574495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8d3f-7232-406a-98c9-dc44d94477bb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.574495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff8d3f-7232-406a-98c9-dc44d94477bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.582877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff8d3f-7232-406a-98c9-dc44d94477bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:41.585158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:41.585797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.586104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.586373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.587245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] RBAC: Adding query filter params (role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=565e1a8b9de14089bb47a45102841158, user.id=f9a9404845604b45b51c1b5c3c8f05b4) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:41.587545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:41.588978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-bfff8d3f-7232-406a-98c9-dc44d94477bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:41.591621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:41.592507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:41.593334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:41.599493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 92/184] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:41.599493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e154-d7db-4fed-8496-8a5505d9be20 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.599493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e154-d7db-4fed-8496-8a5505d9be20 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.599688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 93/185] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:41 2022] GET /identity/v3/role_assignments?user.id=f9a9404845604b45b51c1b5c3c8f05b4&scope.project.id=565e1a8b9de14089bb47a45102841158&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:41.599985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6e154-d7db-4fed-8496-8a5505d9be20 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.600056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:41.600137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 93/186] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:41.601780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6e154-d7db-4fed-8496-8a5505d9be20 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:41.697830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:41.743920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73552a1-51b4-4cb7-b5a1-e3af6ff22699 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:41.750679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6e154-d7db-4fed-8496-8a5505d9be20 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:41.791953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95382ad2-7afa-4301-b4d9-4e483fa35b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:41.792546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382ad2-7afa-4301-b4d9-4e483fa35b1a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.792936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382ad2-7afa-4301-b4d9-4e483fa35b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.793108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95382ad2-7afa-4301-b4d9-4e483fa35b1a None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.793863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95382ad2-7afa-4301-b4d9-4e483fa35b1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:41.794200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95382ad2-7afa-4301-b4d9-4e483fa35b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:41.795765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95382ad2-7afa-4301-b4d9-4e483fa35b1a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:41.800159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491875-6ceb-4dc5-860a-48f848841dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:41.800159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491875-6ceb-4dc5-860a-48f848841dca None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.800680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491875-6ceb-4dc5-860a-48f848841dca None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.800680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491875-6ceb-4dc5-860a-48f848841dca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.805642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0491875-6ceb-4dc5-860a-48f848841dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:41.806643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 94/187] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:41.807826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0491875-6ceb-4dc5-860a-48f848841dca None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:41.808100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddf51-7c12-4f2a-83f9-0a0602f2aabb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.808392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddf51-7c12-4f2a-83f9-0a0602f2aabb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.808673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fddf51-7c12-4f2a-83f9-0a0602f2aabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.809494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 94/188] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:41.813264 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491875-6ceb-4dc5-860a-48f848841dca None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:41.830672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-64fddf51-7c12-4f2a-83f9-0a0602f2aabb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:41.832311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-64fddf51-7c12-4f2a-83f9-0a0602f2aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:41.879513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:41.914045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 95/189] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:41.914045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fddf51-7c12-4f2a-83f9-0a0602f2aabb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:41.945837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491875-6ceb-4dc5-860a-48f848841dca None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:41.977705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:41.983718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0c7e0-19a3-476c-813a-ee1f8d4c609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:41.984581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0c7e0-19a3-476c-813a-ee1f8d4c609f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:41.984862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0c7e0-19a3-476c-813a-ee1f8d4c609f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:41.985141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0c7e0-19a3-476c-813a-ee1f8d4c609f None admin] PATH_INFO: `/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:41.998774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0c7e0-19a3-476c-813a-ee1f8d4c609f None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7c5b34e2141b4b0fcc68beaea1fef)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:42.000333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0c7e0-19a3-476c-813a-ee1f8d4c609f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:42.002417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 95/190] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:41 2022] GET /identity/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:42.003188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0c7e0-19a3-476c-813a-ee1f8d4c609f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:42.031102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fddf51-7c12-4f2a-83f9-0a0602f2aabb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:42.072712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c30a4e-a981-426e-b9bf-3be1b0b2624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:42.073428 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30a4e-a981-426e-b9bf-3be1b0b2624c None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:42.073705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30a4e-a981-426e-b9bf-3be1b0b2624c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:42.073972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30a4e-a981-426e-b9bf-3be1b0b2624c None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:42.074798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c30a4e-a981-426e-b9bf-3be1b0b2624c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:42.076188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c30a4e-a981-426e-b9bf-3be1b0b2624c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:42.110482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0c7e0-19a3-476c-813a-ee1f8d4c609f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:42.148792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c28ee4-ac86-4844-9599-552644aabec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:42.150283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c28ee4-ac86-4844-9599-552644aabec3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:42.150568 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c28ee4-ac86-4844-9599-552644aabec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:42.150842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c28ee4-ac86-4844-9599-552644aabec3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:42.161332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c28ee4-ac86-4844-9599-552644aabec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c7c28ee4-ac86-4844-9599-552644aabec3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:42.169712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:42.170930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 96/191] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:22:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:42.171909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c28ee4-ac86-4844-9599-552644aabec3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:42.186116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 96/192] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:22:41 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:42.186116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c30a4e-a981-426e-b9bf-3be1b0b2624c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:42.222279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:42.246273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:42.307544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c30a4e-a981-426e-b9bf-3be1b0b2624c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:42.319247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c28ee4-ac86-4844-9599-552644aabec3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:42.349682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:42.350848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:42.351398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:42.351967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:42.353781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:42.354369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:42.356195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:42.364908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ebb90-450f-414e-aaba-82d7e9e6776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:42.365569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ebb90-450f-414e-aaba-82d7e9e6776e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:42.365846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ebb90-450f-414e-aaba-82d7e9e6776e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:42.366149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ebb90-450f-414e-aaba-82d7e9e6776e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:42.367278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 97/193] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:22:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:42.373004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:42.451811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ebb90-450f-414e-aaba-82d7e9e6776e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:42.453289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ebb90-450f-414e-aaba-82d7e9e6776e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:42.488892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:42.500404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27711ad6-3296-4873-a30e-b84412552162 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:42.514171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:42.540985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cf5bd-e81b-4f8e-8587-006a316c3e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:42.541920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cf5bd-e81b-4f8e-8587-006a316c3e8b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:42.542229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cf5bd-e81b-4f8e-8587-006a316c3e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:42.542503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cf5bd-e81b-4f8e-8587-006a316c3e8b None admin] PATH_INFO: `/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:42.544453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cf5bd-e81b-4f8e-8587-006a316c3e8b None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7c5b34e2141b4b0fcc68beaea1fef)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:42.545912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cf5bd-e81b-4f8e-8587-006a316c3e8b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:42.547992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 98/194] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:42 2022] GET /identity/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:42.554737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cf5bd-e81b-4f8e-8587-006a316c3e8b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:42.579383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 97/195] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:42.585417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ebb90-450f-414e-aaba-82d7e9e6776e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:42.702430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cf5bd-e81b-4f8e-8587-006a316c3e8b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:42.714520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ebb90-450f-414e-aaba-82d7e9e6776e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:42.745126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a487ba-0c5d-4d61-8508-97fb4e61f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:42.745760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a487ba-0c5d-4d61-8508-97fb4e61f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:42.746080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a487ba-0c5d-4d61-8508-97fb4e61f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:42.746379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a487ba-0c5d-4d61-8508-97fb4e61f1d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:42.753343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321d4a7-8e95-4db4-9b29-e0580cff989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:42.754530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d4a7-8e95-4db4-9b29-e0580cff989e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:42.755016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d4a7-8e95-4db4-9b29-e0580cff989e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:42.755484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321d4a7-8e95-4db4-9b29-e0580cff989e None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:42.756907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321d4a7-8e95-4db4-9b29-e0580cff989e None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:42.758652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321d4a7-8e95-4db4-9b29-e0580cff989e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:42.761551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 98/196] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:42 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:42.767349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321d4a7-8e95-4db4-9b29-e0580cff989e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:42.779837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:42.787373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:42.823621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a487ba-0c5d-4d61-8508-97fb4e61f1d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:42.826113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a487ba-0c5d-4d61-8508-97fb4e61f1d4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:42.877234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321d4a7-8e95-4db4-9b29-e0580cff989e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:42.947240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 99/197] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:42.953064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:42.953218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a487ba-0c5d-4d61-8508-97fb4e61f1d4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:42.954112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:42.954600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:42.955062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:42.956087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2, user.id=e1b7c5b34e2141b4b0fcc68beaea1fef) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:42.956580 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:42.958250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:42.976710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 99/198] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:42 2022] GET /identity/v3/role_assignments?user.id=e1b7c5b34e2141b4b0fcc68beaea1fef&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=fe643140d2134736a54afd972d47d43f => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:43.024950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:43.070863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a487ba-0c5d-4d61-8508-97fb4e61f1d4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:43.116317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c5285-06f6-4b03-a5bd-3dfc05c620ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:43.117188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5285-06f6-4b03-a5bd-3dfc05c620ac None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:43.117467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5285-06f6-4b03-a5bd-3dfc05c620ac None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:43.117738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c5285-06f6-4b03-a5bd-3dfc05c620ac None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:43.121833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c5285-06f6-4b03-a5bd-3dfc05c620ac None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:43.123392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c5285-06f6-4b03-a5bd-3dfc05c620ac None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:43.125241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 100/199] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:42 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:43.131458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:43.239718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:43.260432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea34ab-d309-47e4-968d-5af11be83959 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:43.297181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3853a-d281-46c0-a30f-115db17c731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:43.297832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3853a-d281-46c0-a30f-115db17c731e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:43.298135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3853a-d281-46c0-a30f-115db17c731e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:43.298406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3853a-d281-46c0-a30f-115db17c731e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:43.299235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3853a-d281-46c0-a30f-115db17c731e None admin] RBAC: Adding query filter params (role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2, user.id=e1b7c5b34e2141b4b0fcc68beaea1fef) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:43.299603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3853a-d281-46c0-a30f-115db17c731e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:43.301120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3853a-d281-46c0-a30f-115db17c731e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:43.307335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 100/200] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:43 2022] GET /identity/v3/role_assignments?user.id=e1b7c5b34e2141b4b0fcc68beaea1fef&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:43.376219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06272fe5-1835-4b18-88d3-621e67b1f624 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:43.376863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06272fe5-1835-4b18-88d3-621e67b1f624 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:43.377378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06272fe5-1835-4b18-88d3-621e67b1f624 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:43.379445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 101/201] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:43.386174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db870-cdc9-446c-b756-1a3075b0a5f5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:43.386431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db870-cdc9-446c-b756-1a3075b0a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:43.386647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db870-cdc9-446c-b756-1a3075b0a5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:43.408364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-274db870-cdc9-446c-b756-1a3075b0a5f5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:43.409538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-274db870-cdc9-446c-b756-1a3075b0a5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:43.489504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 101/202] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:43.526032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06272fe5-1835-4b18-88d3-621e67b1f624 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:43.666776 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06272fe5-1835-4b18-88d3-621e67b1f624 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:43.695400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:43.709008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f86b14-715a-4a09-8a25-cc9ee15e4f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:43.710508 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f86b14-715a-4a09-8a25-cc9ee15e4f9b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:43.710936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f86b14-715a-4a09-8a25-cc9ee15e4f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:43.711355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f86b14-715a-4a09-8a25-cc9ee15e4f9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:43.726992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f86b14-715a-4a09-8a25-cc9ee15e4f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-01f86b14-715a-4a09-8a25-cc9ee15e4f9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:43.735080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:43.737265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:43.738407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:43.739502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 102/203] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:43.746136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274db870-cdc9-446c-b756-1a3075b0a5f5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:43.884295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:43.912576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274db870-cdc9-446c-b756-1a3075b0a5f5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:43.947839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:43.948432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:43.948710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:43.948980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:43.949724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:43.950047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:43.951434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:43.959728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 102/204] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:43.966035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f86b14-715a-4a09-8a25-cc9ee15e4f9b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:44.102625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f86b14-715a-4a09-8a25-cc9ee15e4f9b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:44.217111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cfd8f-ff19-4b44-8ef9-607ff86d9b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:44.218309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cfd8f-ff19-4b44-8ef9-607ff86d9b8f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:44.218774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cfd8f-ff19-4b44-8ef9-607ff86d9b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:44.219226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cfd8f-ff19-4b44-8ef9-607ff86d9b8f None admin] PATH_INFO: `/v3/users/80ed1ab312494a05b50dd11198efaa3a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:44.220627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cfd8f-ff19-4b44-8ef9-607ff86d9b8f None admin] RBAC: Authorizing `identity:get_user(user_id=80ed1ab312494a05b50dd11198efaa3a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:44.222312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711cfd8f-ff19-4b44-8ef9-607ff86d9b8f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:44.224140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 103/205] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:43 2022] GET /identity/v3/users/80ed1ab312494a05b50dd11198efaa3a => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:44.229603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:44.394738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a046ed-3d32-4c7c-a154-a370851b1ce1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:44.428569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6445-357a-429f-98ef-26af9a7f937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:44.429210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6445-357a-429f-98ef-26af9a7f937d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:44.429496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6445-357a-429f-98ef-26af9a7f937d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:44.429770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade6445-357a-429f-98ef-26af9a7f937d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:44.433925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:44.513161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade6445-357a-429f-98ef-26af9a7f937d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:44.514572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade6445-357a-429f-98ef-26af9a7f937d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:44.615371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 103/206] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:44.621625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cfd8f-ff19-4b44-8ef9-607ff86d9b8f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:44.709500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:44.770919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cfd8f-ff19-4b44-8ef9-607ff86d9b8f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:44.823618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873820c-2dee-4339-ae8d-e60f9da45384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:44.824491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873820c-2dee-4339-ae8d-e60f9da45384 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:44.824768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873820c-2dee-4339-ae8d-e60f9da45384 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:44.825040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873820c-2dee-4339-ae8d-e60f9da45384 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:44.826265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873820c-2dee-4339-ae8d-e60f9da45384 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:44.827723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873820c-2dee-4339-ae8d-e60f9da45384 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:44.829742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 104/207] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:44 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:44.835229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6445-357a-429f-98ef-26af9a7f937d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:44.897085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:44.983800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade6445-357a-429f-98ef-26af9a7f937d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:45.037479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22751fa-106f-4942-993d-8cf0cfea3301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:45.038089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22751fa-106f-4942-993d-8cf0cfea3301 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.038374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22751fa-106f-4942-993d-8cf0cfea3301 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.038650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22751fa-106f-4942-993d-8cf0cfea3301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.039486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22751fa-106f-4942-993d-8cf0cfea3301 None admin] RBAC: Adding query filter params (role.id=e1b545f08a884bf4b8bd6526ad868009, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0, user.id=80ed1ab312494a05b50dd11198efaa3a) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:45.039894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22751fa-106f-4942-993d-8cf0cfea3301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:45.041990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22751fa-106f-4942-993d-8cf0cfea3301 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:45.048582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 104/208] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:44 2022] GET /identity/v3/role_assignments?user.id=80ed1ab312494a05b50dd11198efaa3a&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=e1b545f08a884bf4b8bd6526ad868009 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:45.266324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32f97-7621-4654-a349-898d631cc55d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.266701 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32f97-7621-4654-a349-898d631cc55d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.266904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac32f97-7621-4654-a349-898d631cc55d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.268300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 105/209] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:45.274114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e3fa-23ac-40b4-a98d-7013244a23b3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.275275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e3fa-23ac-40b4-a98d-7013244a23b3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.275655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4e3fa-23ac-40b4-a98d-7013244a23b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.303324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9ff4e3fa-23ac-40b4-a98d-7013244a23b3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:45.304463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9ff4e3fa-23ac-40b4-a98d-7013244a23b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:45.388169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 105/210] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:45.411535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32f97-7621-4654-a349-898d631cc55d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:45.523163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac32f97-7621-4654-a349-898d631cc55d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:45.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a793-2dce-4956-94bb-41c5c90187a4 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.528994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a793-2dce-4956-94bb-41c5c90187a4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.529267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91a793-2dce-4956-94bb-41c5c90187a4 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.530675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 106/211] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:45.536632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538937-04d5-4b18-949d-195c5fbf9949 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.536917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538937-04d5-4b18-949d-195c5fbf9949 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.537188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a538937-04d5-4b18-949d-195c5fbf9949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.552344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:45.576698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1a538937-04d5-4b18-949d-195c5fbf9949 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:45.576901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e8c2b-94ba-46cb-8d6b-58fa5a735d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:45.576998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1a538937-04d5-4b18-949d-195c5fbf9949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:45.577080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e8c2b-94ba-46cb-8d6b-58fa5a735d43 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.577080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e8c2b-94ba-46cb-8d6b-58fa5a735d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.577080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e8c2b-94ba-46cb-8d6b-58fa5a735d43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.585973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e8c2b-94ba-46cb-8d6b-58fa5a735d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5d2e8c2b-94ba-46cb-8d6b-58fa5a735d43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:45.596273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:45.597216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:45.598160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 106/212] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:45.599570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:45.607220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e8c2b-94ba-46cb-8d6b-58fa5a735d43 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:45.658781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 107/213] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:45.689417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538937-04d5-4b18-949d-195c5fbf9949 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:45.721271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e8c2b-94ba-46cb-8d6b-58fa5a735d43 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:45.759905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:45.760573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.760855 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.761130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.761889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:45.762232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:45.763758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:45.772474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 107/214] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:45.783120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:45.816454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a538937-04d5-4b18-949d-195c5fbf9949 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:45.840714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:45.854709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6644a-ccf8-418d-9612-972ce7693a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:45.855860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6644a-ccf8-418d-9612-972ce7693a0a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.856331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6644a-ccf8-418d-9612-972ce7693a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.856813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6644a-ccf8-418d-9612-972ce7693a0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.858171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6644a-ccf8-418d-9612-972ce7693a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:45.859877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6644a-ccf8-418d-9612-972ce7693a0a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:45.861791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 108/215] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:45.867527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6644a-ccf8-418d-9612-972ce7693a0a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:45.904203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:45.910172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0220377-213d-4159-b9f3-66340ac950e2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:45.953124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edc72-8fe4-45f2-92ee-b79cfa40e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:45.954041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edc72-8fe4-45f2-92ee-b79cfa40e46a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.954326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edc72-8fe4-45f2-92ee-b79cfa40e46a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.954595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edc72-8fe4-45f2-92ee-b79cfa40e46a None admin] PATH_INFO: `/v3/users/9b82ff9e1b204c3f9e5f14b8cfeedafb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.969310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edc72-8fe4-45f2-92ee-b79cfa40e46a None admin] RBAC: Authorizing `identity:get_user(user_id=9b82ff9e1b204c3f9e5f14b8cfeedafb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:45.970908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edc72-8fe4-45f2-92ee-b79cfa40e46a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:45.974449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 108/216] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:45 2022] GET /identity/v3/users/9b82ff9e1b204c3f9e5f14b8cfeedafb => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:45.974449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73f34a-4b48-477e-b86e-ac03e1fb5aaa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:45.974449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73f34a-4b48-477e-b86e-ac03e1fb5aaa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:45.974716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73f34a-4b48-477e-b86e-ac03e1fb5aaa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:45.975971 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 109/217] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:45.979714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73f34a-4b48-477e-b86e-ac03e1fb5aaa None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:45.988278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6644a-ccf8-418d-9612-972ce7693a0a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:46.022834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b968-3be6-4ab5-a467-10dc501624b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:46.023493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b968-3be6-4ab5-a467-10dc501624b6 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.023771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b968-3be6-4ab5-a467-10dc501624b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.024044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b968-3be6-4ab5-a467-10dc501624b6 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.025116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b968-3be6-4ab5-a467-10dc501624b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:46.026588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64b968-3be6-4ab5-a467-10dc501624b6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:46.080725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73f34a-4b48-477e-b86e-ac03e1fb5aaa None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:46.083057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:46.113434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f1f26-bf6b-491b-8eca-7545ad8a8a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:46.114031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f1f26-bf6b-491b-8eca-7545ad8a8a87 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.114321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f1f26-bf6b-491b-8eca-7545ad8a8a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.114704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f1f26-bf6b-491b-8eca-7545ad8a8a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.128299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 109/218] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:22:45 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:46.129605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8dcad-3cc0-444d-af2f-5ba51965a809 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.129892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8dcad-3cc0-444d-af2f-5ba51965a809 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.131891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8dcad-3cc0-444d-af2f-5ba51965a809 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.131891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 110/219] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:46.132509 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f976194-7bc5-466c-b305-e5eb168903d4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.132792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f976194-7bc5-466c-b305-e5eb168903d4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.133067 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f976194-7bc5-466c-b305-e5eb168903d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.151623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9f976194-7bc5-466c-b305-e5eb168903d4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:46.152853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9f976194-7bc5-466c-b305-e5eb168903d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:46.203043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f1f26-bf6b-491b-8eca-7545ad8a8a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:46.204538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f1f26-bf6b-491b-8eca-7545ad8a8a87 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:46.229708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 111/220] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:46.231100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3095deb-d7e1-4c8f-a8dd-924b99b172bd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.231385 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3095deb-d7e1-4c8f-a8dd-924b99b172bd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.231659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3095deb-d7e1-4c8f-a8dd-924b99b172bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.255041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d3095deb-d7e1-4c8f-a8dd-924b99b172bd None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:46.256250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d3095deb-d7e1-4c8f-a8dd-924b99b172bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:46.268171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:46.326743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 110/221] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:46.332699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f1f26-bf6b-491b-8eca-7545ad8a8a87 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:46.335049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 112/222] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:46.336375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3095deb-d7e1-4c8f-a8dd-924b99b172bd None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:46.336598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:46.460119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f1f26-bf6b-491b-8eca-7545ad8a8a87 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:46.469808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3095deb-d7e1-4c8f-a8dd-924b99b172bd None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:46.501511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f19d8-908f-4a21-bff9-b2bd195a2311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:46.502356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f19d8-908f-4a21-bff9-b2bd195a2311 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.502624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f19d8-908f-4a21-bff9-b2bd195a2311 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.502896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f19d8-908f-4a21-bff9-b2bd195a2311 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.509797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9be4-74ed-484c-b9bc-04d7b9312818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:46.510694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9be4-74ed-484c-b9bc-04d7b9312818 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.514125 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9be4-74ed-484c-b9bc-04d7b9312818 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.514125 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9be4-74ed-484c-b9bc-04d7b9312818 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.515197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9be4-74ed-484c-b9bc-04d7b9312818 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:46.515901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f19d8-908f-4a21-bff9-b2bd195a2311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:46.517072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9be4-74ed-484c-b9bc-04d7b9312818 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:46.519289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 113/223] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:46 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:46.520188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9be4-74ed-484c-b9bc-04d7b9312818 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d37f19d8-908f-4a21-bff9-b2bd195a2311 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:46.525995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:46.527098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:46.528024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 111/224] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:46.528777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f19d8-908f-4a21-bff9-b2bd195a2311 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:46.541783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:46.613323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:46.645341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9be4-74ed-484c-b9bc-04d7b9312818 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:46.666652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f19d8-908f-4a21-bff9-b2bd195a2311 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:46.685854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54575-3eb4-4e7f-8ea3-94f8cad99d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:46.686920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54575-3eb4-4e7f-8ea3-94f8cad99d42 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.687439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54575-3eb4-4e7f-8ea3-94f8cad99d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.687875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf54575-3eb4-4e7f-8ea3-94f8cad99d42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.699927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf54575-3eb4-4e7f-8ea3-94f8cad99d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:46.707320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:46.707968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.708245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.708516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.709344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] RBAC: Adding query filter params (role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2, user.id=9b82ff9e1b204c3f9e5f14b8cfeedafb) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:46.709649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1bf54575-3eb4-4e7f-8ea3-94f8cad99d42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:46.709936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:46.711054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:46.712550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:46.713191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:46.714815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 114/225] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:22:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:46.715789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54575-3eb4-4e7f-8ea3-94f8cad99d42 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:46.723755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 112/226] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:46 2022] GET /identity/v3/role_assignments?user.id=9b82ff9e1b204c3f9e5f14b8cfeedafb&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:46.724872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:46.847331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:46.871611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f220c-2a98-4f14-8f48-99a1f66ce1e1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:46.907918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf54575-3eb4-4e7f-8ea3-94f8cad99d42 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:46.926657 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:46.935386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:46.936065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.936356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.936742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.937432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:46.937736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:46.939138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:46.955053 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 113/227] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:22:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:46.957503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:46.958641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:46.959498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:46.959760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:46.960028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:46.960778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:46.961129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:46.962787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:46.973353 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 115/228] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:46.981682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:47.150678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b651d53-1b78-485b-9a61-bbbec37c4ae5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:47.168212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be9fda-2c82-4c20-8d41-a7815c3c4751 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:47.197365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd59bb-3297-4c97-9b27-1f64605c05fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:47.198399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd59bb-3297-4c97-9b27-1f64605c05fd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:47.198676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd59bb-3297-4c97-9b27-1f64605c05fd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:47.199049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd59bb-3297-4c97-9b27-1f64605c05fd None admin] PATH_INFO: `/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:47.207008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd59bb-3297-4c97-9b27-1f64605c05fd None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7c5b34e2141b4b0fcc68beaea1fef)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:47.208747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd59bb-3297-4c97-9b27-1f64605c05fd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:47.210491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 116/229] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:46 2022] GET /identity/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:47.219360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd59bb-3297-4c97-9b27-1f64605c05fd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:47.222173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:47.233006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171fe6d-360f-4102-b3f1-2a03d38ad0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:47.233892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171fe6d-360f-4102-b3f1-2a03d38ad0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:47.236311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171fe6d-360f-4102-b3f1-2a03d38ad0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:47.236642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171fe6d-360f-4102-b3f1-2a03d38ad0b5 None admin] PATH_INFO: `/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:47.240307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171fe6d-360f-4102-b3f1-2a03d38ad0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7c5b34e2141b4b0fcc68beaea1fef)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:47.242731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171fe6d-360f-4102-b3f1-2a03d38ad0b5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:47.248903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 114/230] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:46 2022] GET /identity/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:47.273844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171fe6d-360f-4102-b3f1-2a03d38ad0b5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:47.363365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:47.417244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd59bb-3297-4c97-9b27-1f64605c05fd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:47.444548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171fe6d-360f-4102-b3f1-2a03d38ad0b5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:47.475334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aeb39-9c8c-4eb2-97d0-417326673418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:47.476113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aeb39-9c8c-4eb2-97d0-417326673418 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:47.476392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aeb39-9c8c-4eb2-97d0-417326673418 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:47.476662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283aeb39-9c8c-4eb2-97d0-417326673418 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:47.478652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aeb39-9c8c-4eb2-97d0-417326673418 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:47.480109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283aeb39-9c8c-4eb2-97d0-417326673418 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:47.482148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 117/231] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:47 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:47.487529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aeb39-9c8c-4eb2-97d0-417326673418 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:47.512176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b4177-3e59-4395-b526-d6bb6a37f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:47.513045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4177-3e59-4395-b526-d6bb6a37f814 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:47.513320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4177-3e59-4395-b526-d6bb6a37f814 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:47.513593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b4177-3e59-4395-b526-d6bb6a37f814 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:47.515505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b4177-3e59-4395-b526-d6bb6a37f814 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:47.516937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b4177-3e59-4395-b526-d6bb6a37f814 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:47.521681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 115/232] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:47 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:47.525617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b4177-3e59-4395-b526-d6bb6a37f814 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:47.611506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:47.661161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283aeb39-9c8c-4eb2-97d0-417326673418 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:47.716266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b4177-3e59-4395-b526-d6bb6a37f814 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:47.726687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696a85b-2051-4d96-8f5f-df60fddccec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:47.728057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a85b-2051-4d96-8f5f-df60fddccec5 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:47.728333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a85b-2051-4d96-8f5f-df60fddccec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:47.728603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696a85b-2051-4d96-8f5f-df60fddccec5 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/users/e1b7c5b34e2141b4b0fcc68beaea1fef/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:47.732355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696a85b-2051-4d96-8f5f-df60fddccec5 None admin] RBAC: Authorizing `identity:create_grant(project_id=eacc7bad87f34a58a49e5be42278a2b2, user_id=e1b7c5b34e2141b4b0fcc68beaea1fef, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:47.733814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696a85b-2051-4d96-8f5f-df60fddccec5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:47.756922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:47.766156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613394ee-009b-4e88-a7a6-af6ca609093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:47.767224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613394ee-009b-4e88-a7a6-af6ca609093e None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:47.767507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613394ee-009b-4e88-a7a6-af6ca609093e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:47.767783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613394ee-009b-4e88-a7a6-af6ca609093e None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/users/e1b7c5b34e2141b4b0fcc68beaea1fef/roles/6fa4573097ea4494b215fa0be868f8cd` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:47.770292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613394ee-009b-4e88-a7a6-af6ca609093e None admin] RBAC: Authorizing `identity:create_grant(project_id=eacc7bad87f34a58a49e5be42278a2b2, user_id=e1b7c5b34e2141b4b0fcc68beaea1fef, role_id=6fa4573097ea4494b215fa0be868f8cd)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:47.771725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613394ee-009b-4e88-a7a6-af6ca609093e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:47.803200 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 118/233] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:47 2022] PUT /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/users/e1b7c5b34e2141b4b0fcc68beaea1fef/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:22:47.866040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 116/234] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:47 2022] PUT /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/users/e1b7c5b34e2141b4b0fcc68beaea1fef/roles/6fa4573097ea4494b215fa0be868f8cd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:22:48.724759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62167-3479-44a7-a74a-92910f12da19 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:48.725488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62167-3479-44a7-a74a-92910f12da19 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:48.725488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b62167-3479-44a7-a74a-92910f12da19 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:48.726961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 119/235] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:48.732757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780389d7-4e1d-46c6-9e3f-b2f2881772a2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:48.733229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780389d7-4e1d-46c6-9e3f-b2f2881772a2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:48.733510 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780389d7-4e1d-46c6-9e3f-b2f2881772a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:48.751229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-780389d7-4e1d-46c6-9e3f-b2f2881772a2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:48.752410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-780389d7-4e1d-46c6-9e3f-b2f2881772a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:48.845538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 117/236] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:48.877660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b62167-3479-44a7-a74a-92910f12da19 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:48.960977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9130f-1f9c-43d9-ba99-2fb2e59cc349 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:48.961655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9130f-1f9c-43d9-ba99-2fb2e59cc349 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:48.962178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9130f-1f9c-43d9-ba99-2fb2e59cc349 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:48.964038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 118/237] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:48.969215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6b19-0bd3-469a-850f-0e8685ec0ad7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:48.969742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6b19-0bd3-469a-850f-0e8685ec0ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:48.970291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6b19-0bd3-469a-850f-0e8685ec0ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:48.987205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3aad6b19-0bd3-469a-850f-0e8685ec0ad7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:48.988678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3aad6b19-0bd3-469a-850f-0e8685ec0ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:48.989458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b62167-3479-44a7-a74a-92910f12da19 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:49.027984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:49.050199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85c55d-c463-4d03-b1fd-7d35c41b39e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:49.052578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85c55d-c463-4d03-b1fd-7d35c41b39e9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.052864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85c55d-c463-4d03-b1fd-7d35c41b39e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.053139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85c55d-c463-4d03-b1fd-7d35c41b39e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.078715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85c55d-c463-4d03-b1fd-7d35c41b39e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:49.095454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 119/238] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-4e85c55d-c463-4d03-b1fd-7d35c41b39e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:49.096244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:49.097380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:49.098405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:49.100518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 120/239] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:49.106583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad6b19-0bd3-469a-850f-0e8685ec0ad7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:49.131050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85c55d-c463-4d03-b1fd-7d35c41b39e9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:49.182412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:49.254583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad6b19-0bd3-469a-850f-0e8685ec0ad7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:49.317951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85c55d-c463-4d03-b1fd-7d35c41b39e9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:49.319195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:49.320199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.320720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.321946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.322994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:49.323505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:49.325105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:49.344964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 120/240] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:49.350686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:49.364080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0fe52-b990-4ea2-a8d4-e5f4c85d1ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:49.364891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0fe52-b990-4ea2-a8d4-e5f4c85d1ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.365172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0fe52-b990-4ea2-a8d4-e5f4c85d1ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.365445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0fe52-b990-4ea2-a8d4-e5f4c85d1ee8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.370949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0fe52-b990-4ea2-a8d4-e5f4c85d1ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:49.372483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0fe52-b990-4ea2-a8d4-e5f4c85d1ee8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:49.374303 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 121/241] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:49.380973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0fe52-b990-4ea2-a8d4-e5f4c85d1ee8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:49.471096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:49.482038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd48800-f119-4599-93fc-1c6ebe95e448 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:49.491269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:49.518792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab928d9f-83b6-4d1c-ac08-1a2c64bfbae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:49.519592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab928d9f-83b6-4d1c-ac08-1a2c64bfbae5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.519871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab928d9f-83b6-4d1c-ac08-1a2c64bfbae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.520148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab928d9f-83b6-4d1c-ac08-1a2c64bfbae5 None admin] PATH_INFO: `/v3/users/837b374b45da47e98c995a6fa05a4ca3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.526944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0fe52-b990-4ea2-a8d4-e5f4c85d1ee8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:49.541809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab928d9f-83b6-4d1c-ac08-1a2c64bfbae5 None admin] RBAC: Authorizing `identity:get_user(user_id=837b374b45da47e98c995a6fa05a4ca3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:49.545046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab928d9f-83b6-4d1c-ac08-1a2c64bfbae5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:49.552319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 121/242] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:49 2022] GET /identity/v3/users/837b374b45da47e98c995a6fa05a4ca3 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:49.553989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accdd1-6b84-48c0-8ebc-943418314a0f None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.554298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accdd1-6b84-48c0-8ebc-943418314a0f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.554577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31accdd1-6b84-48c0-8ebc-943418314a0f None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.560569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 122/243] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:49.560569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accdd1-6b84-48c0-8ebc-943418314a0f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:49.574261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc2e60-570c-41cf-afdd-be023e8f8d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:49.575300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc2e60-570c-41cf-afdd-be023e8f8d68 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.575813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc2e60-570c-41cf-afdd-be023e8f8d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.576337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc2e60-570c-41cf-afdd-be023e8f8d68 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.577400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc2e60-570c-41cf-afdd-be023e8f8d68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:49.579189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc2e60-570c-41cf-afdd-be023e8f8d68 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:49.645043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 122/244] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:22:49 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:49.646969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1e2f1-ac50-4175-a86e-f77e54d6c542 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.647691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1e2f1-ac50-4175-a86e-f77e54d6c542 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.648751 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1e2f1-ac50-4175-a86e-f77e54d6c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.670723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0ac1e2f1-ac50-4175-a86e-f77e54d6c542 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:49.672513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0ac1e2f1-ac50-4175-a86e-f77e54d6c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:49.685088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31accdd1-6b84-48c0-8ebc-943418314a0f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:49.754868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a9d75-c5bc-49d8-a651-cb9b8c748e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:49.755595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9d75-c5bc-49d8-a651-cb9b8c748e46 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.755885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9d75-c5bc-49d8-a651-cb9b8c748e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.756190 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a9d75-c5bc-49d8-a651-cb9b8c748e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.764149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 123/245] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:49.791880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1e2f1-ac50-4175-a86e-f77e54d6c542 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:49.845761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:49.852081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:49.918835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1e2f1-ac50-4175-a86e-f77e54d6c542 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:49.940981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a9d75-c5bc-49d8-a651-cb9b8c748e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:49.943681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a9d75-c5bc-49d8-a651-cb9b8c748e46 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:49.961869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512df56-af5d-44f8-95bc-9804b9203c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:49.962741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512df56-af5d-44f8-95bc-9804b9203c7c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:49.963013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512df56-af5d-44f8-95bc-9804b9203c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:49.963276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512df56-af5d-44f8-95bc-9804b9203c7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:49.974897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512df56-af5d-44f8-95bc-9804b9203c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c512df56-af5d-44f8-95bc-9804b9203c7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:49.983411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:49.984360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:49.985184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 124/246] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:49.994962 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512df56-af5d-44f8-95bc-9804b9203c7c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:50.079275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 123/247] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:50.085161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a9d75-c5bc-49d8-a651-cb9b8c748e46 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:50.138950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512df56-af5d-44f8-95bc-9804b9203c7c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:50.142529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:50.167025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:50.185588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:50.188401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.188401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.188401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.188401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:50.188401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:50.190519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:50.204944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 125/248] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:50.214032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:50.230339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a9d75-c5bc-49d8-a651-cb9b8c748e46 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:50.283812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f2a9-fc30-4f2e-9598-85852bd140a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:50.285668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f2a9-fc30-4f2e-9598-85852bd140a9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.286242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f2a9-fc30-4f2e-9598-85852bd140a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.287008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808f2a9-fc30-4f2e-9598-85852bd140a9 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.288694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f2a9-fc30-4f2e-9598-85852bd140a9 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:50.291999 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808f2a9-fc30-4f2e-9598-85852bd140a9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:50.295425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 124/249] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:50 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:50.301946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f2a9-fc30-4f2e-9598-85852bd140a9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:50.356409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646a26c-63ac-4c5c-98e1-b18e47a54df0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:50.419341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964ee32-901d-4893-b90f-859b03aac0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:50.420250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ee32-901d-4893-b90f-859b03aac0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.420537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ee32-901d-4893-b90f-859b03aac0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.420867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964ee32-901d-4893-b90f-859b03aac0e9 None admin] PATH_INFO: `/v3/users/9b82ff9e1b204c3f9e5f14b8cfeedafb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.424205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964ee32-901d-4893-b90f-859b03aac0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=9b82ff9e1b204c3f9e5f14b8cfeedafb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:50.429011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964ee32-901d-4893-b90f-859b03aac0e9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:50.430882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 126/250] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:50 2022] GET /identity/v3/users/9b82ff9e1b204c3f9e5f14b8cfeedafb => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:50.459461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964ee32-901d-4893-b90f-859b03aac0e9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:50.469494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808f2a9-fc30-4f2e-9598-85852bd140a9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:50.530093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:50.530093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.530093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.530093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.530590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] RBAC: Adding query filter params (role.id=e1b545f08a884bf4b8bd6526ad868009, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2, user.id=837b374b45da47e98c995a6fa05a4ca3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:50.530590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:50.530590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:50.530590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:50.532681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:50.537328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 125/251] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:50 2022] GET /identity/v3/role_assignments?user.id=837b374b45da47e98c995a6fa05a4ca3&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=e1b545f08a884bf4b8bd6526ad868009 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:50.611057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964ee32-901d-4893-b90f-859b03aac0e9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:50.648876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfc7b8-6cd8-411a-83ab-e89622b0e116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:50.649849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfc7b8-6cd8-411a-83ab-e89622b0e116 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.650246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfc7b8-6cd8-411a-83ab-e89622b0e116 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.650533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfc7b8-6cd8-411a-83ab-e89622b0e116 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.651756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfc7b8-6cd8-411a-83ab-e89622b0e116 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:50.653218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfc7b8-6cd8-411a-83ab-e89622b0e116 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:50.655267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 127/252] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:50 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:50.660779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:50.715007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775db46-3b82-4c79-a60d-4cef1843dcac None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.715313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775db46-3b82-4c79-a60d-4cef1843dcac None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.715609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775db46-3b82-4c79-a60d-4cef1843dcac None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.716996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 128/253] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:22:50.718088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5e5ce-a7f4-4e11-987b-6beb1ada3e30 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.718369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5e5ce-a7f4-4e11-987b-6beb1ada3e30 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.718641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5e5ce-a7f4-4e11-987b-6beb1ada3e30 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.719855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 129/254] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:50.725439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db4514-0890-4c1b-b96c-affa782ba2a1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.725729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db4514-0890-4c1b-b96c-affa782ba2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.726026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db4514-0890-4c1b-b96c-affa782ba2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.744002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b4db4514-0890-4c1b-b96c-affa782ba2a1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:50.745233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b4db4514-0890-4c1b-b96c-affa782ba2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:50.807057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65497496-8a1b-465c-8cb2-001fa746b986 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:50.862310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 130/255] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:50.863641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee9f0-03b4-4bc8-a12b-9d7fea28e67e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.863928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee9f0-03b4-4bc8-a12b-9d7fea28e67e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.864205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee9f0-03b4-4bc8-a12b-9d7fea28e67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.866767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9dbac-1c81-4f86-a68b-524b642c2fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:50.867735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9dbac-1c81-4f86-a68b-524b642c2fee None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:50.868639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9dbac-1c81-4f86-a68b-524b642c2fee None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:50.869123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9dbac-1c81-4f86-a68b-524b642c2fee None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/users/9b82ff9e1b204c3f9e5f14b8cfeedafb/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:50.875421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9dbac-1c81-4f86-a68b-524b642c2fee None admin] RBAC: Authorizing `identity:create_grant(project_id=eacc7bad87f34a58a49e5be42278a2b2, user_id=9b82ff9e1b204c3f9e5f14b8cfeedafb, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:50.876899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9dbac-1c81-4f86-a68b-524b642c2fee None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:50.882028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f82ee9f0-03b4-4bc8-a12b-9d7fea28e67e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:50.883218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f82ee9f0-03b4-4bc8-a12b-9d7fea28e67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:50.914129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:50.956214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 131/256] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:50.957155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee9f0-03b4-4bc8-a12b-9d7fea28e67e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:50.974355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 126/257] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:50 2022] PUT /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/users/9b82ff9e1b204c3f9e5f14b8cfeedafb/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:22:50.994299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9dbac-1c81-4f86-a68b-524b642c2fee None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:51.124541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:51.172408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee9f0-03b4-4bc8-a12b-9d7fea28e67e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:51.210102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9dbac-1c81-4f86-a68b-524b642c2fee None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:51.220757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f520b85-420e-45f9-8787-0c50fe1e87f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:51.221573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f520b85-420e-45f9-8787-0c50fe1e87f6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:51.221839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f520b85-420e-45f9-8787-0c50fe1e87f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:51.222156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f520b85-420e-45f9-8787-0c50fe1e87f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:51.233991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f520b85-420e-45f9-8787-0c50fe1e87f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8f520b85-420e-45f9-8787-0c50fe1e87f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:51.242531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:51.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:51.244298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 132/258] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:22:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:51.255049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f520b85-420e-45f9-8787-0c50fe1e87f6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:51.268542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0ade6-0e0f-48e7-8b1a-082405a7c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:51.269499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ade6-0e0f-48e7-8b1a-082405a7c40f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:51.270226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ade6-0e0f-48e7-8b1a-082405a7c40f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:51.270629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ade6-0e0f-48e7-8b1a-082405a7c40f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:51.285708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:51.292384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0ade6-0e0f-48e7-8b1a-082405a7c40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1cf0ade6-0e0f-48e7-8b1a-082405a7c40f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:51.304754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:51.306707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:51.307525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 127/259] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:22:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:22:51.311004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0ade6-0e0f-48e7-8b1a-082405a7c40f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:51.420257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f520b85-420e-45f9-8787-0c50fe1e87f6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:51.480061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0ade6-0e0f-48e7-8b1a-082405a7c40f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:51.481674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:51.482375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:51.482660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:51.482945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:51.484290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:51.484290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:51.485389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:51.510042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 133/260] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:22:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:51.512143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:51.535112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:51.547795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:51.548473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:51.548755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:51.549026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:51.549785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:51.550121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:51.551513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:51.572893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 128/261] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:51.578026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:51.654407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:51.667446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef8a2f-ee30-4796-bad0-9ad208cf1b2d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:51.711425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43e57-3d44-4ed9-896b-caf8d1996938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:51.712254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43e57-3d44-4ed9-896b-caf8d1996938 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:51.712535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43e57-3d44-4ed9-896b-caf8d1996938 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:51.712808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b43e57-3d44-4ed9-896b-caf8d1996938 None admin] PATH_INFO: `/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:51.715553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43e57-3d44-4ed9-896b-caf8d1996938 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7c5b34e2141b4b0fcc68beaea1fef)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:51.717014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b43e57-3d44-4ed9-896b-caf8d1996938 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:51.721006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 134/262] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:51 2022] GET /identity/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:51.726963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43e57-3d44-4ed9-896b-caf8d1996938 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:51.809608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0cefe-8019-40f2-823d-cfc7224a2059 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:51.880039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988cb48-7600-4b16-bdfc-f6175697ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:51.880931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988cb48-7600-4b16-bdfc-f6175697ff76 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:51.881218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988cb48-7600-4b16-bdfc-f6175697ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:51.881495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988cb48-7600-4b16-bdfc-f6175697ff76 None admin] PATH_INFO: `/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:51.884809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988cb48-7600-4b16-bdfc-f6175697ff76 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b7c5b34e2141b4b0fcc68beaea1fef)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:51.886334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5988cb48-7600-4b16-bdfc-f6175697ff76 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:51.894590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 129/263] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:51 2022] GET /identity/v3/users/e1b7c5b34e2141b4b0fcc68beaea1fef => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:51.899749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988cb48-7600-4b16-bdfc-f6175697ff76 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:51.923080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b43e57-3d44-4ed9-896b-caf8d1996938 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:51.969639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8aecd-be66-49f3-8ddb-2fc1b2682ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:51.970235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8aecd-be66-49f3-8ddb-2fc1b2682ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:51.970518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8aecd-be66-49f3-8ddb-2fc1b2682ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:51.971046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8aecd-be66-49f3-8ddb-2fc1b2682ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:52.006982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:52.017776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:52.072796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8aecd-be66-49f3-8ddb-2fc1b2682ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:52.074463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8aecd-be66-49f3-8ddb-2fc1b2682ff7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:52.080806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988cb48-7600-4b16-bdfc-f6175697ff76 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:52.118400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81db82-24f3-4018-a864-5745e54a4e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:52.119441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81db82-24f3-4018-a864-5745e54a4e15 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:52.119898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81db82-24f3-4018-a864-5745e54a4e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:52.120542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81db82-24f3-4018-a864-5745e54a4e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:52.235688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 135/264] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:52.256898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8aecd-be66-49f3-8ddb-2fc1b2682ff7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:52.277271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81db82-24f3-4018-a864-5745e54a4e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:52.279198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81db82-24f3-4018-a864-5745e54a4e15 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:52.343930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:52.416645 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:52.417353 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8aecd-be66-49f3-8ddb-2fc1b2682ff7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:52.478768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca76ba-98cf-49ae-9fd9-f0f14630e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:52.479682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca76ba-98cf-49ae-9fd9-f0f14630e338 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:52.479930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca76ba-98cf-49ae-9fd9-f0f14630e338 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:52.480312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca76ba-98cf-49ae-9fd9-f0f14630e338 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:52.481645 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca76ba-98cf-49ae-9fd9-f0f14630e338 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:52.483153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca76ba-98cf-49ae-9fd9-f0f14630e338 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:52.485007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 136/265] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:52 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:52.491120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca76ba-98cf-49ae-9fd9-f0f14630e338 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:52.505893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 130/266] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 22:22:52.511935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81db82-24f3-4018-a864-5745e54a4e15 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:52.614070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81db82-24f3-4018-a864-5745e54a4e15 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:52.650367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701da08-4af7-4901-b7ff-1fc0520f6137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:52.651237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701da08-4af7-4901-b7ff-1fc0520f6137 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:52.651515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701da08-4af7-4901-b7ff-1fc0520f6137 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:52.651788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701da08-4af7-4901-b7ff-1fc0520f6137 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:52.652988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701da08-4af7-4901-b7ff-1fc0520f6137 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:52.654476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701da08-4af7-4901-b7ff-1fc0520f6137 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:52.656537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 131/267] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:52 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:52.662103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701da08-4af7-4901-b7ff-1fc0520f6137 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:52.681372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:52.688375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca76ba-98cf-49ae-9fd9-f0f14630e338 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:52.709119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:52.739654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656d65a-350c-4b92-92f6-2a0b87e39e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:52.740327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656d65a-350c-4b92-92f6-2a0b87e39e23 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:52.740605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656d65a-350c-4b92-92f6-2a0b87e39e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:52.740877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656d65a-350c-4b92-92f6-2a0b87e39e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:52.741780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656d65a-350c-4b92-92f6-2a0b87e39e23 None admin] RBAC: Adding query filter params (role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2, user.id=e1b7c5b34e2141b4b0fcc68beaea1fef) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:52.742052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656d65a-350c-4b92-92f6-2a0b87e39e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:52.744306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656d65a-350c-4b92-92f6-2a0b87e39e23 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:52.762029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 137/268] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:52 2022] GET /identity/v3/role_assignments?user.id=e1b7c5b34e2141b4b0fcc68beaea1fef&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:52.789470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701da08-4af7-4901-b7ff-1fc0520f6137 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:52.829485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c1bbd-7c5c-46ec-a97f-91223d343a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:52.830503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1bbd-7c5c-46ec-a97f-91223d343a3c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:52.830984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1bbd-7c5c-46ec-a97f-91223d343a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:52.831433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c1bbd-7c5c-46ec-a97f-91223d343a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:52.832453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c1bbd-7c5c-46ec-a97f-91223d343a3c None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2, user.id=e1b7c5b34e2141b4b0fcc68beaea1fef) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:52.832945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c1bbd-7c5c-46ec-a97f-91223d343a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:52.834608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c1bbd-7c5c-46ec-a97f-91223d343a3c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:52.842439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 132/269] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:52 2022] GET /identity/v3/role_assignments?user.id=e1b7c5b34e2141b4b0fcc68beaea1fef&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=fe643140d2134736a54afd972d47d43f => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:53.360345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e753c-30b1-48d7-8857-c593b0713ec1 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.360831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e753c-30b1-48d7-8857-c593b0713ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.360831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e753c-30b1-48d7-8857-c593b0713ec1 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.362351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 138/270] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:53.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3247f-8f7c-4fdd-8c5d-8dd7427b6406 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.369695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3247f-8f7c-4fdd-8c5d-8dd7427b6406 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.370195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3247f-8f7c-4fdd-8c5d-8dd7427b6406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.388573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a4f3247f-8f7c-4fdd-8c5d-8dd7427b6406 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:53.390905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a4f3247f-8f7c-4fdd-8c5d-8dd7427b6406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:53.461746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 133/271] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:53.475965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269485c-3fc4-4ea3-b647-3d9b82bf4392 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.476242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269485c-3fc4-4ea3-b647-3d9b82bf4392 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.476520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269485c-3fc4-4ea3-b647-3d9b82bf4392 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.478011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 139/272] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:53.483507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab0f61-9203-46f8-9e8d-84e9f7bf9fc8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.484044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab0f61-9203-46f8-9e8d-84e9f7bf9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.484322 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab0f61-9203-46f8-9e8d-84e9f7bf9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.495384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269485c-3fc4-4ea3-b647-3d9b82bf4392 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:53.506370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1aab0f61-9203-46f8-9e8d-84e9f7bf9fc8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:53.507746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1aab0f61-9203-46f8-9e8d-84e9f7bf9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:53.510803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:53.602043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 134/273] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:53.622736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab0f61-9203-46f8-9e8d-84e9f7bf9fc8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:53.640130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269485c-3fc4-4ea3-b647-3d9b82bf4392 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:53.685570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13d0a-a2cb-48c2-977b-0f69cc769c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:53.687018 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13d0a-a2cb-48c2-977b-0f69cc769c5b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.687296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13d0a-a2cb-48c2-977b-0f69cc769c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.687572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d13d0a-a2cb-48c2-977b-0f69cc769c5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.701321 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d13d0a-a2cb-48c2-977b-0f69cc769c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-63d13d0a-a2cb-48c2-977b-0f69cc769c5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:53.709127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:53.710052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:53.710872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 140/274] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:22:53.719385 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13d0a-a2cb-48c2-977b-0f69cc769c5b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:53.747943 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab0f61-9203-46f8-9e8d-84e9f7bf9fc8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:53.779687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:53.784452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196240c-90d3-48b3-9aab-a2869e449725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:53.785300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196240c-90d3-48b3-9aab-a2869e449725 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.785700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196240c-90d3-48b3-9aab-a2869e449725 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.785892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196240c-90d3-48b3-9aab-a2869e449725 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.787063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196240c-90d3-48b3-9aab-a2869e449725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:53.792064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196240c-90d3-48b3-9aab-a2869e449725 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:53.793505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 135/275] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:53.795579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea488-796a-44ba-a97c-f16c4cd1093b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.796019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea488-796a-44ba-a97c-f16c4cd1093b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.796297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea488-796a-44ba-a97c-f16c4cd1093b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.798384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 136/276] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:53.799083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea488-796a-44ba-a97c-f16c4cd1093b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:53.812744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:53.837905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d13d0a-a2cb-48c2-977b-0f69cc769c5b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:53.873497 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd970686-1841-4588-852b-272e63d1ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:53.874194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970686-1841-4588-852b-272e63d1ced2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.874471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970686-1841-4588-852b-272e63d1ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.874742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd970686-1841-4588-852b-272e63d1ced2 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.875466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd970686-1841-4588-852b-272e63d1ced2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:53.875773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd970686-1841-4588-852b-272e63d1ced2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:53.877158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd970686-1841-4588-852b-272e63d1ced2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:53.885653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 141/277] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:53.887909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555a936-6fa7-49fe-8992-6a74e047885e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.888918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555a936-6fa7-49fe-8992-6a74e047885e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.889405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555a936-6fa7-49fe-8992-6a74e047885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.908093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6555a936-6fa7-49fe-8992-6a74e047885e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:53.909291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6555a936-6fa7-49fe-8992-6a74e047885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:53.913869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea488-796a-44ba-a97c-f16c4cd1093b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:53.951255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101f8a3-482d-42cd-a33e-b5602b3786f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:53.951923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101f8a3-482d-42cd-a33e-b5602b3786f2 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:53.952204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101f8a3-482d-42cd-a33e-b5602b3786f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:53.952480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101f8a3-482d-42cd-a33e-b5602b3786f2 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:53.953195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101f8a3-482d-42cd-a33e-b5602b3786f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:53.955123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101f8a3-482d-42cd-a33e-b5602b3786f2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:53.981798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 142/278] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:53.982671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555a936-6fa7-49fe-8992-6a74e047885e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.019075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:54.052945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 137/279] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:22:53 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:54.053924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101f8a3-482d-42cd-a33e-b5602b3786f2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.107369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555a936-6fa7-49fe-8992-6a74e047885e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:54.148352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb41c0-a82d-427e-9cc5-3c5803f8c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:54.149739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb41c0-a82d-427e-9cc5-3c5803f8c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.150045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb41c0-a82d-427e-9cc5-3c5803f8c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.150316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb41c0-a82d-427e-9cc5-3c5803f8c6e0 None admin] PATH_INFO: `/v3/users/6a33f1ab99f341fea143101b228d2aa3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.179312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb41c0-a82d-427e-9cc5-3c5803f8c6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=6a33f1ab99f341fea143101b228d2aa3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:54.183981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb41c0-a82d-427e-9cc5-3c5803f8c6e0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:54.183981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 143/280] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:53 2022] GET /identity/v3/users/6a33f1ab99f341fea143101b228d2aa3 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:54.188909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb41c0-a82d-427e-9cc5-3c5803f8c6e0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.200173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:54.253231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101f8a3-482d-42cd-a33e-b5602b3786f2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:54.298396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649ac4e-2f8e-44d8-87a6-8d104e68777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:54.299191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ac4e-2f8e-44d8-87a6-8d104e68777c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.299589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ac4e-2f8e-44d8-87a6-8d104e68777c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.299868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649ac4e-2f8e-44d8-87a6-8d104e68777c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.308255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:54.312825 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649ac4e-2f8e-44d8-87a6-8d104e68777c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:54.316109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb41c0-a82d-427e-9cc5-3c5803f8c6e0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c649ac4e-2f8e-44d8-87a6-8d104e68777c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:54.320823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:54.321730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 138/281] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:54.323923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9ecd4-f671-4eb6-834b-090624af1075 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.324648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9ecd4-f671-4eb6-834b-090624af1075 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.324648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9ecd4-f671-4eb6-834b-090624af1075 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.326518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 139/282] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:54.329018 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9ecd4-f671-4eb6-834b-090624af1075 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.371349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ea721-eb1c-411a-b12e-5aad9c768655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:54.372271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea721-eb1c-411a-b12e-5aad9c768655 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.372572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea721-eb1c-411a-b12e-5aad9c768655 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.373737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ea721-eb1c-411a-b12e-5aad9c768655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.374621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ea721-eb1c-411a-b12e-5aad9c768655 None admin] RBAC: Adding query filter params (role.id=a080c6e46ea94d0792cb2cb7c51b4f65, user.id=6a33f1ab99f341fea143101b228d2aa3, scope.system=all) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:54.374938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ea721-eb1c-411a-b12e-5aad9c768655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:54.376404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ea721-eb1c-411a-b12e-5aad9c768655 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:54.385951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 144/283] 10.222.0.70 () {56 vars in 1308 bytes} [Wed May 18 22:22:54 2022] GET /identity/v3/role_assignments?user.id=6a33f1ab99f341fea143101b228d2aa3&scope.system=all&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:54.387065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631126-2eec-4dd8-8af9-ae0a059ae6ad None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.387407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631126-2eec-4dd8-8af9-ae0a059ae6ad None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.387693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7631126-2eec-4dd8-8af9-ae0a059ae6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.408462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f7631126-2eec-4dd8-8af9-ae0a059ae6ad None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:54.409913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f7631126-2eec-4dd8-8af9-ae0a059ae6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:54.467217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9ecd4-f671-4eb6-834b-090624af1075 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:54.486948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 145/284] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:54.502376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:54.514378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7631126-2eec-4dd8-8af9-ae0a059ae6ad None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.517062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:54.518768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.519061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.519338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.520125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:54.525421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:54.525421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:54.533820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 140/285] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:54.540011 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.654174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:54.668260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7631126-2eec-4dd8-8af9-ae0a059ae6ad None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:54.690168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae71c4f-caec-49f2-9bf2-c39ae6fd883a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:54.706577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888205f-a320-48ce-bea6-a90237b1558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:54.707795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888205f-a320-48ce-bea6-a90237b1558e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.708384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888205f-a320-48ce-bea6-a90237b1558e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.709640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888205f-a320-48ce-bea6-a90237b1558e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.721499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888205f-a320-48ce-bea6-a90237b1558e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f888205f-a320-48ce-bea6-a90237b1558e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:54.731080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:54.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:54.732821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:54.735708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 146/286] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:22:54.741791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888205f-a320-48ce-bea6-a90237b1558e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.750729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239d2e0-f1ca-4685-9b86-502d956913a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:54.751624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239d2e0-f1ca-4685-9b86-502d956913a9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.751903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239d2e0-f1ca-4685-9b86-502d956913a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.752171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239d2e0-f1ca-4685-9b86-502d956913a9 None admin] PATH_INFO: `/v3/users/837b374b45da47e98c995a6fa05a4ca3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.753634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239d2e0-f1ca-4685-9b86-502d956913a9 None admin] RBAC: Authorizing `identity:get_user(user_id=837b374b45da47e98c995a6fa05a4ca3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:54.754995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239d2e0-f1ca-4685-9b86-502d956913a9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:54.756897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 141/287] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:54 2022] GET /identity/v3/users/837b374b45da47e98c995a6fa05a4ca3 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:54.762782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239d2e0-f1ca-4685-9b86-502d956913a9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.841987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:54.858665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888205f-a320-48ce-bea6-a90237b1558e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:54.894189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239d2e0-f1ca-4685-9b86-502d956913a9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:54.909329 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:54.910364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.912220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.913410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.914578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:54.915153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:54.917096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:54.936436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 147/288] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:54.942159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:54.958645 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d120a-45bd-42e6-b7c5-17b3cc07c7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:54.959514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d120a-45bd-42e6-b7c5-17b3cc07c7cd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:54.959786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d120a-45bd-42e6-b7c5-17b3cc07c7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:54.960054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d120a-45bd-42e6-b7c5-17b3cc07c7cd None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:54.961278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d120a-45bd-42e6-b7c5-17b3cc07c7cd None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:54.962833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d120a-45bd-42e6-b7c5-17b3cc07c7cd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:54.964541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 142/289] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:54 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:54.966687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:54.971565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d120a-45bd-42e6-b7c5-17b3cc07c7cd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:55.109390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d120a-45bd-42e6-b7c5-17b3cc07c7cd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:55.135282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:55.147643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b5734-0d5f-4495-984a-0bf1a8813339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:55.148730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5734-0d5f-4495-984a-0bf1a8813339 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:55.149886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5734-0d5f-4495-984a-0bf1a8813339 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:55.150314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b5734-0d5f-4495-984a-0bf1a8813339 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/users/837b374b45da47e98c995a6fa05a4ca3/roles/e1b545f08a884bf4b8bd6526ad868009` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:55.152314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b5734-0d5f-4495-984a-0bf1a8813339 None admin] RBAC: Authorizing `identity:create_grant(project_id=eacc7bad87f34a58a49e5be42278a2b2, user_id=837b374b45da47e98c995a6fa05a4ca3, role_id=e1b545f08a884bf4b8bd6526ad868009)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:55.153742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b5734-0d5f-4495-984a-0bf1a8813339 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:55.159466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf253-c5cf-433f-a1c3-d6f222f16ac9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:55.198391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc3835-2b73-444d-af97-63d2766346e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:55.199646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3835-2b73-444d-af97-63d2766346e3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:55.200102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3835-2b73-444d-af97-63d2766346e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:55.200544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc3835-2b73-444d-af97-63d2766346e3 None admin] PATH_INFO: `/v3/users/9b82ff9e1b204c3f9e5f14b8cfeedafb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:55.201938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc3835-2b73-444d-af97-63d2766346e3 None admin] RBAC: Authorizing `identity:get_user(user_id=9b82ff9e1b204c3f9e5f14b8cfeedafb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:55.203693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc3835-2b73-444d-af97-63d2766346e3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:55.205881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 148/290] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:54 2022] GET /identity/v3/users/9b82ff9e1b204c3f9e5f14b8cfeedafb => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:55.211090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc3835-2b73-444d-af97-63d2766346e3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:55.231447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 143/291] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:22:54 2022] PUT /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/users/837b374b45da47e98c995a6fa05a4ca3/roles/e1b545f08a884bf4b8bd6526ad868009 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:22:55.309447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:55.333832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc3835-2b73-444d-af97-63d2766346e3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:55.371960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2f088-a04b-437c-83a7-f9bd81398939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:55.373386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f088-a04b-437c-83a7-f9bd81398939 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:55.373839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f088-a04b-437c-83a7-f9bd81398939 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:55.374308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2f088-a04b-437c-83a7-f9bd81398939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:55.466538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2f088-a04b-437c-83a7-f9bd81398939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:55.467924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2f088-a04b-437c-83a7-f9bd81398939 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:55.578794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:55.602334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 149/292] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:55.607635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b5734-0d5f-4495-984a-0bf1a8813339 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:55.765390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b5734-0d5f-4495-984a-0bf1a8813339 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:55.816103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddd903-5b35-498b-ac54-585ac79651e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:55.817329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddd903-5b35-498b-ac54-585ac79651e3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:55.817801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddd903-5b35-498b-ac54-585ac79651e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:55.818545 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddd903-5b35-498b-ac54-585ac79651e3 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:55.819916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddd903-5b35-498b-ac54-585ac79651e3 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:55.821843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddd903-5b35-498b-ac54-585ac79651e3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:55.823783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 144/293] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:55 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:55.829636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2f088-a04b-437c-83a7-f9bd81398939 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:55.969611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2f088-a04b-437c-83a7-f9bd81398939 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:56.013502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d006b4-340f-4186-8068-ad12117df0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:56.014179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d006b4-340f-4186-8068-ad12117df0ee None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:56.014483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d006b4-340f-4186-8068-ad12117df0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:56.014753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d006b4-340f-4186-8068-ad12117df0ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:56.015640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d006b4-340f-4186-8068-ad12117df0ee None admin] RBAC: Adding query filter params (role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2, user.id=9b82ff9e1b204c3f9e5f14b8cfeedafb) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:56.015894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d006b4-340f-4186-8068-ad12117df0ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:56.017337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d006b4-340f-4186-8068-ad12117df0ee None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:56.024084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 150/294] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:55 2022] GET /identity/v3/role_assignments?user.id=9b82ff9e1b204c3f9e5f14b8cfeedafb&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:56.830298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4eb9-1ed2-4e77-95d3-0ef5e44dd2d5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:56.830887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4eb9-1ed2-4e77-95d3-0ef5e44dd2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:56.830887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4eb9-1ed2-4e77-95d3-0ef5e44dd2d5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:56.832302 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 145/295] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:56.837906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a62db-644a-42f7-b31e-33123fecc1bf None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:56.838364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a62db-644a-42f7-b31e-33123fecc1bf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:56.838540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a62db-644a-42f7-b31e-33123fecc1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:56.855711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b59a62db-644a-42f7-b31e-33123fecc1bf None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:56.856874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b59a62db-644a-42f7-b31e-33123fecc1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:56.885367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f87b-acaf-4cb3-ba34-02e14136fc29 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:56.885660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f87b-acaf-4cb3-ba34-02e14136fc29 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:56.885927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8f87b-acaf-4cb3-ba34-02e14136fc29 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:56.888328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 146/296] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:22:56.892949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:56.894371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069172e-6d96-4f8c-ab56-7dd36e1f5efe None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:56.894662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069172e-6d96-4f8c-ab56-7dd36e1f5efe None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:56.894938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069172e-6d96-4f8c-ab56-7dd36e1f5efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:56.917511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a069172e-6d96-4f8c-ab56-7dd36e1f5efe None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:56.919321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a069172e-6d96-4f8c-ab56-7dd36e1f5efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:56.924742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 151/297] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:56.950091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a62db-644a-42f7-b31e-33123fecc1bf None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:56.979758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:57.008884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 147/298] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:57.033898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069172e-6d96-4f8c-ab56-7dd36e1f5efe None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:57.070047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a62db-644a-42f7-b31e-33123fecc1bf None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.114258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f50ce-b49e-4489-9d4d-6abfeb8507f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.114973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f50ce-b49e-4489-9d4d-6abfeb8507f9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.115311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f50ce-b49e-4489-9d4d-6abfeb8507f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.115586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f50ce-b49e-4489-9d4d-6abfeb8507f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.128186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f50ce-b49e-4489-9d4d-6abfeb8507f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-dd5f50ce-b49e-4489-9d4d-6abfeb8507f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:57.138439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:57.139366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:57.140179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:22:57.142611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 152/299] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:57.148630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f50ce-b49e-4489-9d4d-6abfeb8507f9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:57.175405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069172e-6d96-4f8c-ab56-7dd36e1f5efe None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.189339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:57.211174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc07ab7-2eea-4674-b245-e806235636a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.212513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07ab7-2eea-4674-b245-e806235636a2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.212811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07ab7-2eea-4674-b245-e806235636a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.213171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc07ab7-2eea-4674-b245-e806235636a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.214378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc07ab7-2eea-4674-b245-e806235636a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:57.215805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc07ab7-2eea-4674-b245-e806235636a2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:57.221795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 148/300] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:57.221795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bf8eb-cb99-4263-b282-90dca7225e0d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.221795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bf8eb-cb99-4263-b282-90dca7225e0d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.221795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bf8eb-cb99-4263-b282-90dca7225e0d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.221795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 149/301] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:57.224956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bf8eb-cb99-4263-b282-90dca7225e0d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:57.270311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f50ce-b49e-4489-9d4d-6abfeb8507f9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.278253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:57.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90562cc4-65f9-406e-91fe-fa260b4dd029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.311015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90562cc4-65f9-406e-91fe-fa260b4dd029 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.311293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90562cc4-65f9-406e-91fe-fa260b4dd029 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.311561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90562cc4-65f9-406e-91fe-fa260b4dd029 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.312300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90562cc4-65f9-406e-91fe-fa260b4dd029 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:57.312605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90562cc4-65f9-406e-91fe-fa260b4dd029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:57.313980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90562cc4-65f9-406e-91fe-fa260b4dd029 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:57.328278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 153/302] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:57.328278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11815b0-b2d8-49bd-9f8b-c41db0b765bf None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.328278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11815b0-b2d8-49bd-9f8b-c41db0b765bf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.328278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11815b0-b2d8-49bd-9f8b-c41db0b765bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.340288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bf8eb-cb99-4263-b282-90dca7225e0d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.343486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f11815b0-b2d8-49bd-9f8b-c41db0b765bf None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:57.344682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f11815b0-b2d8-49bd-9f8b-c41db0b765bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:57.376693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03c41-32aa-48b7-8fb0-49230ae911b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.377356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03c41-32aa-48b7-8fb0-49230ae911b1 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.377639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03c41-32aa-48b7-8fb0-49230ae911b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.378047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03c41-32aa-48b7-8fb0-49230ae911b1 None admin] PATH_INFO: `/v3/groups` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.378947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c03c41-32aa-48b7-8fb0-49230ae911b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:57.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c03c41-32aa-48b7-8fb0-49230ae911b1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:57.415520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 154/303] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:57.426233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11815b0-b2d8-49bd-9f8b-c41db0b765bf None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:57.440426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 150/304] 10.222.0.70 () {60 vars in 1134 bytes} [Wed May 18 22:22:57 2022] POST /identity/v3/groups => generated 229 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:22:57.441491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03c41-32aa-48b7-8fb0-49230ae911b1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:57.457764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:57.563547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11815b0-b2d8-49bd-9f8b-c41db0b765bf None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.572044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03c41-32aa-48b7-8fb0-49230ae911b1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.582752 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:57.606035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec99d-ef56-4759-8a7c-bda82a9f16dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.607324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec99d-ef56-4759-8a7c-bda82a9f16dd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.607792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec99d-ef56-4759-8a7c-bda82a9f16dd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.608238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec99d-ef56-4759-8a7c-bda82a9f16dd None admin] PATH_INFO: `/v3/users/d37397fc92e840929fecc30f513a3b83` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.612574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64ddf0-7c26-4e15-baae-5c996283b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.612973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64ddf0-7c26-4e15-baae-5c996283b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.613326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64ddf0-7c26-4e15-baae-5c996283b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.613671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64ddf0-7c26-4e15-baae-5c996283b5f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.625299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ec99d-ef56-4759-8a7c-bda82a9f16dd None admin] RBAC: Authorizing `identity:get_user(user_id=d37397fc92e840929fecc30f513a3b83)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:57.626857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64ddf0-7c26-4e15-baae-5c996283b5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:57.626987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ec99d-ef56-4759-8a7c-bda82a9f16dd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:57.628876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 155/305] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:57 2022] GET /identity/v3/users/d37397fc92e840929fecc30f513a3b83 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:57.635202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec99d-ef56-4759-8a7c-bda82a9f16dd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-bd64ddf0-7c26-4e15-baae-5c996283b5f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:57.635694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:57.636592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:22:57.637386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:57.638623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 151/306] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:57.643018 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64ddf0-7c26-4e15-baae-5c996283b5f6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:57.739797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:57.765681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec99d-ef56-4759-8a7c-bda82a9f16dd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.769719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64ddf0-7c26-4e15-baae-5c996283b5f6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.808280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.808868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df347ca-2356-4a39-8b02-3792ce530c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.808987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.809206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.809480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.809724 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df347ca-2356-4a39-8b02-3792ce530c0b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.810138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df347ca-2356-4a39-8b02-3792ce530c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.810342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] RBAC: Adding query filter params (role.id=e1b545f08a884bf4b8bd6526ad868009, user.id=d37397fc92e840929fecc30f513a3b83, scope.system=all) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:57.810482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df347ca-2356-4a39-8b02-3792ce530c0b None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.810652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:57.811373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df347ca-2356-4a39-8b02-3792ce530c0b None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:57.811744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df347ca-2356-4a39-8b02-3792ce530c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:57.812087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:57.813227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df347ca-2356-4a39-8b02-3792ce530c0b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:57.817700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 156/307] 10.222.0.70 () {56 vars in 1308 bytes} [Wed May 18 22:22:57 2022] GET /identity/v3/role_assignments?user.id=d37397fc92e840929fecc30f513a3b83&scope.system=all&role.id=e1b545f08a884bf4b8bd6526ad868009 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:57.827388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 152/308] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:57.828828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:57.936203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4c05-4ee7-4577-9ee6-5ecc0f8909ad None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.936712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4c05-4ee7-4577-9ee6-5ecc0f8909ad None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.936712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4c05-4ee7-4577-9ee6-5ecc0f8909ad None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.938356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 153/309] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:22:57.941315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a46fac-69aa-42c9-a7a9-b38753b0204c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:57.944432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaabe5-70a8-4ab9-8dbe-22c4b13e72d4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.944668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaabe5-70a8-4ab9-8dbe-22c4b13e72d4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.944953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaabe5-70a8-4ab9-8dbe-22c4b13e72d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.964029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-05aaabe5-70a8-4ab9-8dbe-22c4b13e72d4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:57.965234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-05aaabe5-70a8-4ab9-8dbe-22c4b13e72d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:57.986465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b10d66-dfe9-42f5-970a-e683c23f2fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:57.987350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10d66-dfe9-42f5-970a-e683c23f2fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:57.987629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10d66-dfe9-42f5-970a-e683c23f2fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:57.987897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10d66-dfe9-42f5-970a-e683c23f2fa6 None admin] PATH_INFO: `/v3/users/6a33f1ab99f341fea143101b228d2aa3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:57.989145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b10d66-dfe9-42f5-970a-e683c23f2fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=6a33f1ab99f341fea143101b228d2aa3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:57.990692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b10d66-dfe9-42f5-970a-e683c23f2fa6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:57.997656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 157/310] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:57 2022] GET /identity/v3/users/6a33f1ab99f341fea143101b228d2aa3 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:57.999480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b10d66-dfe9-42f5-970a-e683c23f2fa6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:58.003482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:58.022256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:58.072817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 154/311] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:22:58.096401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaabe5-70a8-4ab9-8dbe-22c4b13e72d4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:58.126983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b10d66-dfe9-42f5-970a-e683c23f2fa6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:58.164116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5efd32-4d14-418f-b5ac-722e721ccf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:58.165209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5efd32-4d14-418f-b5ac-722e721ccf3b None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:58.165502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5efd32-4d14-418f-b5ac-722e721ccf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:58.165778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5efd32-4d14-418f-b5ac-722e721ccf3b None admin] PATH_INFO: `/v3/system/users/6a33f1ab99f341fea143101b228d2aa3/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:58.167350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5efd32-4d14-418f-b5ac-722e721ccf3b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6a33f1ab99f341fea143101b228d2aa3, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:58.168709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5efd32-4d14-418f-b5ac-722e721ccf3b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:58.225645 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaabe5-70a8-4ab9-8dbe-22c4b13e72d4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:58.250028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 158/312] 10.222.0.70 () {58 vars in 1334 bytes} [Wed May 18 22:22:57 2022] PUT /identity/v3/system/users/6a33f1ab99f341fea143101b228d2aa3/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:22:58.276074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68149f40-c50d-4cba-a493-f664792b55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:58.276888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68149f40-c50d-4cba-a493-f664792b55b4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:58.277170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68149f40-c50d-4cba-a493-f664792b55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:58.277495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68149f40-c50d-4cba-a493-f664792b55b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:58.289996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68149f40-c50d-4cba-a493-f664792b55b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-68149f40-c50d-4cba-a493-f664792b55b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:22:58.298480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:22:58.299451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:22:58.300254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 155/313] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:22:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:22:58.307355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5efd32-4d14-418f-b5ac-722e721ccf3b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:58.434160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5efd32-4d14-418f-b5ac-722e721ccf3b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:58.437917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:58.472286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:58.473178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:58.473621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:58.474088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:58.474966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:58.475397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:58.476967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:58.495491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 159/314] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:22:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:58.501173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68149f40-c50d-4cba-a493-f664792b55b4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:58.525523 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:58.604917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68149f40-c50d-4cba-a493-f664792b55b4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:58.639138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6fb2-f875-4370-bb6d-3a600258c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:58.640010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6fb2-f875-4370-bb6d-3a600258c583 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:58.640289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6fb2-f875-4370-bb6d-3a600258c583 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:58.640560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6fb2-f875-4370-bb6d-3a600258c583 None admin] PATH_INFO: `/v3/users/837b374b45da47e98c995a6fa05a4ca3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:58.641771 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6fb2-f875-4370-bb6d-3a600258c583 None admin] RBAC: Authorizing `identity:get_user(user_id=837b374b45da47e98c995a6fa05a4ca3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:58.643242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6fb2-f875-4370-bb6d-3a600258c583 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:58.645178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 156/315] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:22:58 2022] GET /identity/v3/users/837b374b45da47e98c995a6fa05a4ca3 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:58.651209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:58.762695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5125e-24fe-4274-adea-5df315cd66c2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:58.798216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebce66-c64b-4833-85d1-e7c79a98f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:58.798855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebce66-c64b-4833-85d1-e7c79a98f0ac None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:58.799130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebce66-c64b-4833-85d1-e7c79a98f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:58.799402 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebce66-c64b-4833-85d1-e7c79a98f0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:58.810644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:58.869596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebce66-c64b-4833-85d1-e7c79a98f0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:58.871110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebce66-c64b-4833-85d1-e7c79a98f0ac None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:58.971790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 160/316] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:22:58.978101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6fb2-f875-4370-bb6d-3a600258c583 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:59.075740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:59.088822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6fb2-f875-4370-bb6d-3a600258c583 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:59.122345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94734484-021f-432a-88d7-4c1ae672d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:59.123200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94734484-021f-432a-88d7-4c1ae672d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:59.123476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94734484-021f-432a-88d7-4c1ae672d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:59.123745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94734484-021f-432a-88d7-4c1ae672d9a9 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:59.124915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94734484-021f-432a-88d7-4c1ae672d9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:59.126427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94734484-021f-432a-88d7-4c1ae672d9a9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:59.128181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 157/317] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:22:58 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:22:59.134710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebce66-c64b-4833-85d1-e7c79a98f0ac None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:22:59.177686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:22:59.236850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebce66-c64b-4833-85d1-e7c79a98f0ac None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:22:59.272531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de2aefd-d67b-4a55-87be-55c76fa31c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:22:59.273176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2aefd-d67b-4a55-87be-55c76fa31c2d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:59.273450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2aefd-d67b-4a55-87be-55c76fa31c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:59.273719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de2aefd-d67b-4a55-87be-55c76fa31c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:59.274775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2aefd-d67b-4a55-87be-55c76fa31c2d None admin] RBAC: Adding query filter params (role.id=e1b545f08a884bf4b8bd6526ad868009, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2, user.id=837b374b45da47e98c995a6fa05a4ca3) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:22:59.275231 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2aefd-d67b-4a55-87be-55c76fa31c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:22:59.276711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de2aefd-d67b-4a55-87be-55c76fa31c2d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:22:59.283011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 161/318] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:22:59 2022] GET /identity/v3/role_assignments?user.id=837b374b45da47e98c995a6fa05a4ca3&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=e1b545f08a884bf4b8bd6526ad868009 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:22:59.839277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6e2d-80f6-4015-901c-47d8a9c43477 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:59.839652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6e2d-80f6-4015-901c-47d8a9c43477 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:59.839828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d6e2d-80f6-4015-901c-47d8a9c43477 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:59.841339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 158/319] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:22:59.846368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1385-45ed-489f-87da-62fe33837cd9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:22:59.846656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1385-45ed-489f-87da-62fe33837cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:22:59.846930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d1385-45ed-489f-87da-62fe33837cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:22:59.864196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-639d1385-45ed-489f-87da-62fe33837cd9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:22:59.865367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-639d1385-45ed-489f-87da-62fe33837cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:22:59.935374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 162/320] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:22:59.958662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6e2d-80f6-4015-901c-47d8a9c43477 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:00.080162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d6e2d-80f6-4015-901c-47d8a9c43477 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:00.116292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87e08e-add9-4208-a6a0-0f9cb9d2a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:00.117004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e08e-add9-4208-a6a0-0f9cb9d2a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.117281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e08e-add9-4208-a6a0-0f9cb9d2a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.117550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e08e-add9-4208-a6a0-0f9cb9d2a6c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.119259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87e08e-add9-4208-a6a0-0f9cb9d2a6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:00.120692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87e08e-add9-4208-a6a0-0f9cb9d2a6c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:00.122940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 159/321] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:22:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:00.127855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d1385-45ed-489f-87da-62fe33837cd9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:00.163586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:00.196505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37fa51-841e-4511-b5a1-bec0a7776de9 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.196944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37fa51-841e-4511-b5a1-bec0a7776de9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.197215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37fa51-841e-4511-b5a1-bec0a7776de9 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.198754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 160/322] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:00.203492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c438f-b2e5-4cf0-b26f-c1f2d635d9fb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.203778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c438f-b2e5-4cf0-b26f-c1f2d635d9fb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.204051 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c438f-b2e5-4cf0-b26f-c1f2d635d9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.221259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-595c438f-b2e5-4cf0-b26f-c1f2d635d9fb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:00.222464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-595c438f-b2e5-4cf0-b26f-c1f2d635d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:00.234395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d1385-45ed-489f-87da-62fe33837cd9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:00.241989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:00.273017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e460d3-01ae-4abd-9759-8021f3ccbb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:00.273680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e460d3-01ae-4abd-9759-8021f3ccbb0e None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.274485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e460d3-01ae-4abd-9759-8021f3ccbb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.274830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e460d3-01ae-4abd-9759-8021f3ccbb0e None admin] PATH_INFO: `/v3/groups` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.275530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e460d3-01ae-4abd-9759-8021f3ccbb0e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:00.276963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e460d3-01ae-4abd-9759-8021f3ccbb0e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:00.294505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 161/323] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:00.316502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c438f-b2e5-4cf0-b26f-c1f2d635d9fb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:00.345956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 163/324] 10.222.0.70 () {60 vars in 1134 bytes} [Wed May 18 22:23:00 2022] POST /identity/v3/groups => generated 226 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:00.435276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c438f-b2e5-4cf0-b26f-c1f2d635d9fb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:00.474868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e961167-b413-49bd-9fba-b23aeddedc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:00.475689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961167-b413-49bd-9fba-b23aeddedc7c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.475962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961167-b413-49bd-9fba-b23aeddedc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.476230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961167-b413-49bd-9fba-b23aeddedc7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.488007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e961167-b413-49bd-9fba-b23aeddedc7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2e961167-b413-49bd-9fba-b23aeddedc7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:00.496025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:00.497009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:00.497984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 162/325] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:00.503184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e460d3-01ae-4abd-9759-8021f3ccbb0e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:00.611021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:00.618511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e460d3-01ae-4abd-9759-8021f3ccbb0e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:00.619988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5305-ac56-4d7b-abd7-3a25a5391a94 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.620272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5305-ac56-4d7b-abd7-3a25a5391a94 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.622057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5305-ac56-4d7b-abd7-3a25a5391a94 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.622057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 163/326] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:00.627880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff043-ed55-4a2d-9e9b-f01b049321f5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.628237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff043-ed55-4a2d-9e9b-f01b049321f5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.628584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff043-ed55-4a2d-9e9b-f01b049321f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.650310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3daff043-ed55-4a2d-9e9b-f01b049321f5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:00.652077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3daff043-ed55-4a2d-9e9b-f01b049321f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:00.659949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:00.660616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.660896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.661165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.661913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:00.662305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:00.663699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:00.666347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:00.674471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 164/327] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:00.681011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:00.734708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 164/328] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:00.758206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daff043-ed55-4a2d-9e9b-f01b049321f5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:00.812757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110de894-08ea-4ae4-8571-0e7a063db8d9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:00.861806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd08e7-6960-4fc6-ad1e-2798d20f493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:00.862853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd08e7-6960-4fc6-ad1e-2798d20f493f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.863134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd08e7-6960-4fc6-ad1e-2798d20f493f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.863406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd08e7-6960-4fc6-ad1e-2798d20f493f None admin] PATH_INFO: `/v3/users/d37397fc92e840929fecc30f513a3b83` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.866257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd08e7-6960-4fc6-ad1e-2798d20f493f None admin] RBAC: Authorizing `identity:get_user(user_id=d37397fc92e840929fecc30f513a3b83)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:00.868339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd08e7-6960-4fc6-ad1e-2798d20f493f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:00.870118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 165/329] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:23:00 2022] GET /identity/v3/users/d37397fc92e840929fecc30f513a3b83 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:00.877517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd08e7-6960-4fc6-ad1e-2798d20f493f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:00.899680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daff043-ed55-4a2d-9e9b-f01b049321f5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:00.909298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:00.940196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199bf24-3fac-437d-8dfc-a900c29441e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:00.941105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199bf24-3fac-437d-8dfc-a900c29441e0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:00.941460 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199bf24-3fac-437d-8dfc-a900c29441e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:00.941897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199bf24-3fac-437d-8dfc-a900c29441e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:00.955052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199bf24-3fac-437d-8dfc-a900c29441e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f199bf24-3fac-437d-8dfc-a900c29441e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:00.964665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:00.966421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:00.968010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 165/330] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:00.976451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199bf24-3fac-437d-8dfc-a900c29441e0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:00.989131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:00.992387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd08e7-6960-4fc6-ad1e-2798d20f493f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:01.035072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12010ce-4f20-4a73-b287-20b64baf7e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:01.036259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12010ce-4f20-4a73-b287-20b64baf7e72 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:01.036719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12010ce-4f20-4a73-b287-20b64baf7e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:01.037268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12010ce-4f20-4a73-b287-20b64baf7e72 None admin] PATH_INFO: `/v3/system/users/d37397fc92e840929fecc30f513a3b83/roles/e1b545f08a884bf4b8bd6526ad868009` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:01.039095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12010ce-4f20-4a73-b287-20b64baf7e72 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d37397fc92e840929fecc30f513a3b83, role_id=e1b545f08a884bf4b8bd6526ad868009)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:01.041984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12010ce-4f20-4a73-b287-20b64baf7e72 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:01.094632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 166/331] 10.222.0.70 () {58 vars in 1334 bytes} [Wed May 18 22:23:00 2022] PUT /identity/v3/system/users/d37397fc92e840929fecc30f513a3b83/roles/e1b545f08a884bf4b8bd6526ad868009 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:01.117091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199bf24-3fac-437d-8dfc-a900c29441e0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:01.159343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:01.160350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:01.160801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:01.161252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:01.162226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:01.162746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:01.164369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:01.175662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 166/332] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:01.181712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12010ce-4f20-4a73-b287-20b64baf7e72 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:01.310380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:01.325358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12010ce-4f20-4a73-b287-20b64baf7e72 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:01.369920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba725c33-f794-483a-94cb-32c094c861d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:01.370836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba725c33-f794-483a-94cb-32c094c861d7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:01.371117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba725c33-f794-483a-94cb-32c094c861d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:01.371392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba725c33-f794-483a-94cb-32c094c861d7 None admin] PATH_INFO: `/v3/users/6a33f1ab99f341fea143101b228d2aa3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:01.372677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba725c33-f794-483a-94cb-32c094c861d7 None admin] RBAC: Authorizing `identity:get_user(user_id=6a33f1ab99f341fea143101b228d2aa3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:01.374510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba725c33-f794-483a-94cb-32c094c861d7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:01.377503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 167/333] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:23:01 2022] GET /identity/v3/users/6a33f1ab99f341fea143101b228d2aa3 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:01.382511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:01.472438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:01.520585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035308f-1288-4986-9b0a-9009d1c03309 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:01.564921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6b1c7-a851-46f8-bc98-4914beb24873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:01.565490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6b1c7-a851-46f8-bc98-4914beb24873 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:01.565779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6b1c7-a851-46f8-bc98-4914beb24873 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:01.566083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6b1c7-a851-46f8-bc98-4914beb24873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:01.566912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6b1c7-a851-46f8-bc98-4914beb24873 None admin] RBAC: Adding query filter params (role.id=a080c6e46ea94d0792cb2cb7c51b4f65, user.id=6a33f1ab99f341fea143101b228d2aa3, scope.system=all) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:01.567222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6b1c7-a851-46f8-bc98-4914beb24873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:01.568904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6b1c7-a851-46f8-bc98-4914beb24873 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:01.585451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 167/334] 10.222.0.70 () {56 vars in 1308 bytes} [Wed May 18 22:23:01 2022] GET /identity/v3/role_assignments?user.id=6a33f1ab99f341fea143101b228d2aa3&scope.system=all&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:03.238192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e73c4a-2a2b-41d5-bb76-ecd54f30b815 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:03.238757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e73c4a-2a2b-41d5-bb76-ecd54f30b815 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:03.238757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e73c4a-2a2b-41d5-bb76-ecd54f30b815 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:03.240114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 168/335] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:03.246114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164991c-fa3b-48f0-bfd5-6fcf6511b7e9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:03.246539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164991c-fa3b-48f0-bfd5-6fcf6511b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:03.246736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164991c-fa3b-48f0-bfd5-6fcf6511b7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:03.275122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3164991c-fa3b-48f0-bfd5-6fcf6511b7e9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:03.276353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3164991c-fa3b-48f0-bfd5-6fcf6511b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:03.316898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb1f7-8502-437d-b3fd-88bfe3ee2de8 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:03.317176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb1f7-8502-437d-b3fd-88bfe3ee2de8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:03.317378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eb1f7-8502-437d-b3fd-88bfe3ee2de8 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:03.319325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 169/336] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:03.325355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8a22d-0d1f-42b0-ba0a-f1405bc26b88 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:03.325640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8a22d-0d1f-42b0-ba0a-f1405bc26b88 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:03.325926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8a22d-0d1f-42b0-ba0a-f1405bc26b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:03.356865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-35b8a22d-0d1f-42b0-ba0a-f1405bc26b88 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:03.358080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-35b8a22d-0d1f-42b0-ba0a-f1405bc26b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:03.411681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 168/337] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:03.470534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 170/338] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:03.482505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164991c-fa3b-48f0-bfd5-6fcf6511b7e9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:03.505625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8a22d-0d1f-42b0-ba0a-f1405bc26b88 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:03.573874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:03.634787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164991c-fa3b-48f0-bfd5-6fcf6511b7e9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:03.680878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426e0b-2efa-4e76-a4e6-628a2f6140de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:03.681862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426e0b-2efa-4e76-a4e6-628a2f6140de None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:03.682173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426e0b-2efa-4e76-a4e6-628a2f6140de None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:03.682443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426e0b-2efa-4e76-a4e6-628a2f6140de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:03.703081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c426e0b-2efa-4e76-a4e6-628a2f6140de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6c426e0b-2efa-4e76-a4e6-628a2f6140de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:03.711334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:03.712276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:03.713087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:03.717837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 169/339] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:03.718797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426e0b-2efa-4e76-a4e6-628a2f6140de None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:03.743905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:03.784123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8a22d-0d1f-42b0-ba0a-f1405bc26b88 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:03.887451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670085b-21ab-4006-a555-1882cd212c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:03.888273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670085b-21ab-4006-a555-1882cd212c24 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:03.888549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670085b-21ab-4006-a555-1882cd212c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:03.888815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670085b-21ab-4006-a555-1882cd212c24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:03.922917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670085b-21ab-4006-a555-1882cd212c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:03.924103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426e0b-2efa-4e76-a4e6-628a2f6140de None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0670085b-21ab-4006-a555-1882cd212c24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:03.931372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:03.932305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:03.933109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 171/340] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:23:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:03.940238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670085b-21ab-4006-a555-1882cd212c24 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:03.947512 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:04.000893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:04.001558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:04.001838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:04.002135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:04.002892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:04.003192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:04.004564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:04.024420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 170/341] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:04.030160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:04.167612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670085b-21ab-4006-a555-1882cd212c24 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:04.218990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93638ec-c085-41bc-a59d-246c93503040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:04.225867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93638ec-c085-41bc-a59d-246c93503040 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:04.225867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93638ec-c085-41bc-a59d-246c93503040 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:04.225867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93638ec-c085-41bc-a59d-246c93503040 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:04.225867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93638ec-c085-41bc-a59d-246c93503040 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:04.225867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93638ec-c085-41bc-a59d-246c93503040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:04.225867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93638ec-c085-41bc-a59d-246c93503040 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:04.239911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 172/342] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:04.241262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe87e36-9349-4dd0-bf4a-db96f4df3051 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:04.241546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe87e36-9349-4dd0-bf4a-db96f4df3051 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:04.241822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe87e36-9349-4dd0-bf4a-db96f4df3051 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:04.245119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 173/343] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:04.251297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93a463-a158-4d64-8728-6f79b2516f62 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:04.253705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe87e36-9349-4dd0-bf4a-db96f4df3051 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:04.279289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:04.336359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32da07-976f-4c81-b96f-6b25a389732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:04.338025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32da07-976f-4c81-b96f-6b25a389732e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:04.340564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32da07-976f-4c81-b96f-6b25a389732e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:04.340677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32da07-976f-4c81-b96f-6b25a389732e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:04.396736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe87e36-9349-4dd0-bf4a-db96f4df3051 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:04.424797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:04.436039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21992391-3245-46d8-a605-90749e1a54ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:04.437039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992391-3245-46d8-a605-90749e1a54ff None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:04.437546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992391-3245-46d8-a605-90749e1a54ff None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:04.438093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992391-3245-46d8-a605-90749e1a54ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:04.459914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32da07-976f-4c81-b96f-6b25a389732e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:04.462218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32da07-976f-4c81-b96f-6b25a389732e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:04.514851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21992391-3245-46d8-a605-90749e1a54ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:04.516617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21992391-3245-46d8-a605-90749e1a54ff None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:04.527685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:04.623468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 174/344] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:04.625124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8ba8-4d40-414e-adb2-98e62abc1e04 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:04.625624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8ba8-4d40-414e-adb2-98e62abc1e04 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:04.626165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8ba8-4d40-414e-adb2-98e62abc1e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:04.653223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 171/345] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:04.655732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32da07-976f-4c81-b96f-6b25a389732e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:04.655846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0c8a8ba8-4d40-414e-adb2-98e62abc1e04 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:04.658846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0c8a8ba8-4d40-414e-adb2-98e62abc1e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:04.756316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 175/346] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:04.757491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a8ba8-4d40-414e-adb2-98e62abc1e04 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:04.806088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:04.827409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:04.868660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a8ba8-4d40-414e-adb2-98e62abc1e04 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:04.868989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32da07-976f-4c81-b96f-6b25a389732e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:04.905469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c056d81-f70e-4124-b8a3-0e8f5f2d6469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:04.906605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056d81-f70e-4124-b8a3-0e8f5f2d6469 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:04.907047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056d81-f70e-4124-b8a3-0e8f5f2d6469 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:04.907478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c056d81-f70e-4124-b8a3-0e8f5f2d6469 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:04.908824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c056d81-f70e-4124-b8a3-0e8f5f2d6469 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:04.915087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c056d81-f70e-4124-b8a3-0e8f5f2d6469 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:04.921453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 176/347] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:04 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:04.922856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c056d81-f70e-4124-b8a3-0e8f5f2d6469 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:04.931102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1380a-1c8d-42b9-aa21-725b5e74b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:04.932004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1380a-1c8d-42b9-aa21-725b5e74b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:04.932286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1380a-1c8d-42b9-aa21-725b5e74b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:04.932563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1380a-1c8d-42b9-aa21-725b5e74b5f6 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:04.934954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1380a-1c8d-42b9-aa21-725b5e74b5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:04.936163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1380a-1c8d-42b9-aa21-725b5e74b5f6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:04.946518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 172/348] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:04 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:04.953487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1380a-1c8d-42b9-aa21-725b5e74b5f6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:05.093182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c056d81-f70e-4124-b8a3-0e8f5f2d6469 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:05.096806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1380a-1c8d-42b9-aa21-725b5e74b5f6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:05.106815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:05.141255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa0edd-7ed4-4ef8-a80e-16bf65b15acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:05.142494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa0edd-7ed4-4ef8-a80e-16bf65b15acb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.146068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa0edd-7ed4-4ef8-a80e-16bf65b15acb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.146541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa0edd-7ed4-4ef8-a80e-16bf65b15acb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.148599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d575ed-7236-4540-9247-d9253c30ac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:05.152313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d575ed-7236-4540-9247-d9253c30ac7d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.152888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d575ed-7236-4540-9247-d9253c30ac7d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.153366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d575ed-7236-4540-9247-d9253c30ac7d None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.166373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa0edd-7ed4-4ef8-a80e-16bf65b15acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:05.167061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d575ed-7236-4540-9247-d9253c30ac7d None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:05.168828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d575ed-7236-4540-9247-d9253c30ac7d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:05.170764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 173/349] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:04 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:05.171782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d575ed-7236-4540-9247-d9253c30ac7d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b1fa0edd-7ed4-4ef8-a80e-16bf65b15acb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:05.178253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:05.179228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:05.181053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 177/350] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:05.181973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdda57-89ff-47f1-8a77-75e44d969c90 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.182239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdda57-89ff-47f1-8a77-75e44d969c90 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.182489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdda57-89ff-47f1-8a77-75e44d969c90 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.183753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 178/351] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:05.185963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdda57-89ff-47f1-8a77-75e44d969c90 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:05.190303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:05.314789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d575ed-7236-4540-9247-d9253c30ac7d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:05.323275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdda57-89ff-47f1-8a77-75e44d969c90 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:05.365141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112e64c-8144-4768-a7c0-15706f001c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:05.366082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e64c-8144-4768-a7c0-15706f001c08 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.366330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e64c-8144-4768-a7c0-15706f001c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.366609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112e64c-8144-4768-a7c0-15706f001c08 None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.368408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e64c-8144-4768-a7c0-15706f001c08 None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:05.369894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112e64c-8144-4768-a7c0-15706f001c08 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:05.370632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:05.371447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.371643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 174/352] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:05 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:05.372021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.372512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.373255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a89df-a083-4ebe-8910-d55800580580 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.373255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a89df-a083-4ebe-8910-d55800580580 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.373416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a89df-a083-4ebe-8910-d55800580580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.374398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] RBAC: Adding query filter params (group.id=b012d16444204a71afac16a63d76721d, role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:05.374848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:05.376643 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:05.387789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 179/353] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:05 2022] GET /identity/v3/role_assignments?group.id=b012d16444204a71afac16a63d76721d&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:05.388763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:05.402451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-df8a89df-a083-4ebe-8910-d55800580580 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:05.403690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-df8a89df-a083-4ebe-8910-d55800580580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:05.423953 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:05.494656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 175/354] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:05.496034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287dcc-a19c-4420-a7a1-b201fb074508 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.501916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287dcc-a19c-4420-a7a1-b201fb074508 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.501916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287dcc-a19c-4420-a7a1-b201fb074508 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.501916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 176/355] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:05.501916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287dcc-a19c-4420-a7a1-b201fb074508 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:05.521491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:05.546942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5af0bb-9ef8-4ea4-827c-01f8cd2621fc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:05.595876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9f67a-7e1e-40ce-acc9-e8a2f303b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:05.596349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f67a-7e1e-40ce-acc9-e8a2f303b8fc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.596661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f67a-7e1e-40ce-acc9-e8a2f303b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.596935 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f67a-7e1e-40ce-acc9-e8a2f303b8fc None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.597694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9f67a-7e1e-40ce-acc9-e8a2f303b8fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:05.598017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9f67a-7e1e-40ce-acc9-e8a2f303b8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:05.600099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9f67a-7e1e-40ce-acc9-e8a2f303b8fc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:05.611977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 180/356] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:05.613615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b14ef-357c-4e70-b3f5-e38287ed4d2a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.613615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b14ef-357c-4e70-b3f5-e38287ed4d2a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.613870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b14ef-357c-4e70-b3f5-e38287ed4d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.635492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cb0b14ef-357c-4e70-b3f5-e38287ed4d2a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:05.636925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cb0b14ef-357c-4e70-b3f5-e38287ed4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:05.642575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287dcc-a19c-4420-a7a1-b201fb074508 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:05.697382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb6d3b-a1a3-4214-bb6a-4d1e51ea5b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:05.698053 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6d3b-a1a3-4214-bb6a-4d1e51ea5b22 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.698339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6d3b-a1a3-4214-bb6a-4d1e51ea5b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.698612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb6d3b-a1a3-4214-bb6a-4d1e51ea5b22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.699582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb6d3b-a1a3-4214-bb6a-4d1e51ea5b22 None admin] RBAC: Adding query filter params (group.id=b012d16444204a71afac16a63d76721d, role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:05.699890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb6d3b-a1a3-4214-bb6a-4d1e51ea5b22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:05.701470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb6d3b-a1a3-4214-bb6a-4d1e51ea5b22 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:05.708726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 177/357] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:05 2022] GET /identity/v3/role_assignments?group.id=b012d16444204a71afac16a63d76721d&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:05.710316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1def8-5152-419d-8226-ea5e065b01bd None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.710427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1def8-5152-419d-8226-ea5e065b01bd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.710613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1def8-5152-419d-8226-ea5e065b01bd None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.711937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 178/358] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:05.712662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1def8-5152-419d-8226-ea5e065b01bd None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:05.731110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 181/359] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:05.732318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b14ef-357c-4e70-b3f5-e38287ed4d2a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:05.760327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:05.819854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:05.846880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b14ef-357c-4e70-b3f5-e38287ed4d2a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:05.858912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1def8-5152-419d-8226-ea5e065b01bd None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:05.889834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13424a-952d-4762-bb99-18771b264b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:05.891475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13424a-952d-4762-bb99-18771b264b1a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.892033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13424a-952d-4762-bb99-18771b264b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.892565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13424a-952d-4762-bb99-18771b264b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.925575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a3fc2-84de-4fbe-8cf8-7b752b0e0585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:05.926540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3fc2-84de-4fbe-8cf8-7b752b0e0585 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.926822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3fc2-84de-4fbe-8cf8-7b752b0e0585 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.927092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3fc2-84de-4fbe-8cf8-7b752b0e0585 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.941113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a3fc2-84de-4fbe-8cf8-7b752b0e0585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f35a3fc2-84de-4fbe-8cf8-7b752b0e0585 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:05.949969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:05.951906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:05.952756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 179/360] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:05.954088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3378f-dfbe-4186-9ed5-49ac4e186586 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:05.954088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3378f-dfbe-4186-9ed5-49ac4e186586 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:05.954258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3378f-dfbe-4186-9ed5-49ac4e186586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:05.974240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a8d3378f-dfbe-4186-9ed5-49ac4e186586 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:05.975479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a8d3378f-dfbe-4186-9ed5-49ac4e186586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:05.980831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13424a-952d-4762-bb99-18771b264b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:05.982679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13424a-952d-4762-bb99-18771b264b1a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:06.012736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:06.071203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 180/361] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:06.073169 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3378f-dfbe-4186-9ed5-49ac4e186586 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.131465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 182/362] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:06.132420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13424a-952d-4762-bb99-18771b264b1a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.157320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:06.200538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3378f-dfbe-4186-9ed5-49ac4e186586 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:06.239075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78205c-8ac5-46d9-96dc-cfad31e37bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:06.240108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13424a-952d-4762-bb99-18771b264b1a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:06.240479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78205c-8ac5-46d9-96dc-cfad31e37bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:06.240945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78205c-8ac5-46d9-96dc-cfad31e37bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:06.241411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78205c-8ac5-46d9-96dc-cfad31e37bc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:06.257132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78205c-8ac5-46d9-96dc-cfad31e37bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:06.267277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0f78205c-8ac5-46d9-96dc-cfad31e37bc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:06.268801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:06.269685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:06.270525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:06.271714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 181/363] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:06.274619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78205c-8ac5-46d9-96dc-cfad31e37bc6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.291533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:06.292784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:06.293236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:06.293826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:06.294774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:06.295251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:06.297239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:06.309843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 183/364] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:06.311267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.398875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78205c-8ac5-46d9-96dc-cfad31e37bc6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:06.423614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:06.440675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17f5c-918c-4906-a876-b296d36401a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:06.441706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17f5c-918c-4906-a876-b296d36401a6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:06.441949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17f5c-918c-4906-a876-b296d36401a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:06.442335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef17f5c-918c-4906-a876-b296d36401a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:06.445588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27d584-3bad-433b-af92-6daac7c0614a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:06.455599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef17f5c-918c-4906-a876-b296d36401a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-aef17f5c-918c-4906-a876-b296d36401a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:06.464571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:06.465463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:06.466311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:06.470524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 182/365] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:06.471453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17f5c-918c-4906-a876-b296d36401a6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.493488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6fd66-c1ce-47f2-9db3-b99505caac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:06.494842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6fd66-c1ce-47f2-9db3-b99505caac0e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:06.495296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6fd66-c1ce-47f2-9db3-b99505caac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:06.495756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6fd66-c1ce-47f2-9db3-b99505caac0e None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:06.497464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6fd66-c1ce-47f2-9db3-b99505caac0e None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:06.499132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6fd66-c1ce-47f2-9db3-b99505caac0e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:06.501704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 184/366] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:06.502863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6fd66-c1ce-47f2-9db3-b99505caac0e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.581660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:06.606853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef17f5c-918c-4906-a876-b296d36401a6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:06.638306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6fd66-c1ce-47f2-9db3-b99505caac0e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:06.650788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:06.651514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:06.651857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:06.652200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:06.653104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:06.653475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:06.655041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:06.666328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 183/367] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:06.667321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.683693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897082de-decf-43a1-baff-b1c64dc0327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:06.685347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897082de-decf-43a1-baff-b1c64dc0327d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:06.685801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897082de-decf-43a1-baff-b1c64dc0327d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:06.686670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897082de-decf-43a1-baff-b1c64dc0327d None admin] PATH_INFO: `/v3/users/d37397fc92e840929fecc30f513a3b83` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:06.692617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897082de-decf-43a1-baff-b1c64dc0327d None admin] RBAC: Authorizing `identity:get_user(user_id=d37397fc92e840929fecc30f513a3b83)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:06.694173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897082de-decf-43a1-baff-b1c64dc0327d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:06.698240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 185/368] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/users/d37397fc92e840929fecc30f513a3b83 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:06.699742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897082de-decf-43a1-baff-b1c64dc0327d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.738231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:06.811749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acf98e-67b4-4720-a096-b6df45836a48 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:06.828133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897082de-decf-43a1-baff-b1c64dc0327d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:06.849081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:06.856732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:06.858103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:06.858549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:06.859214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:06.860872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:06.860872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:06.862581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:06.865564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde31b2-72d0-4239-893e-23c2a4fc96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:06.866466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde31b2-72d0-4239-893e-23c2a4fc96e7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:06.866810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde31b2-72d0-4239-893e-23c2a4fc96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:06.867085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde31b2-72d0-4239-893e-23c2a4fc96e7 None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:06.868909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde31b2-72d0-4239-893e-23c2a4fc96e7 None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:06.871579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde31b2-72d0-4239-893e-23c2a4fc96e7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:06.872013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 184/369] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:06.872817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:06.881271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 186/370] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:06.882143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde31b2-72d0-4239-893e-23c2a4fc96e7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:07.008339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f77503-4da6-48af-a3f2-dd14adfd59e4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:07.011772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde31b2-72d0-4239-893e-23c2a4fc96e7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:07.011909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:07.053530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffcf98-52bb-4a7d-a1ab-815bd01f2175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:07.054218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffcf98-52bb-4a7d-a1ab-815bd01f2175 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:07.054493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffcf98-52bb-4a7d-a1ab-815bd01f2175 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:07.054766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beffcf98-52bb-4a7d-a1ab-815bd01f2175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:07.060250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:07.061143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:07.061612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:07.062129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:07.063241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] RBAC: Adding query filter params (role.id=e1b545f08a884bf4b8bd6526ad868009, user.id=d37397fc92e840929fecc30f513a3b83, scope.system=all) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:07.063744 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:07.065503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:07.082256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 187/371] 10.222.0.70 () {56 vars in 1308 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/role_assignments?user.id=d37397fc92e840929fecc30f513a3b83&scope.system=all&role.id=e1b545f08a884bf4b8bd6526ad868009 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:07.083482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:07.156259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffcf98-52bb-4a7d-a1ab-815bd01f2175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:07.157812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beffcf98-52bb-4a7d-a1ab-815bd01f2175 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:07.239895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:07.275493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 185/372] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:07.276250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffcf98-52bb-4a7d-a1ab-815bd01f2175 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:07.280380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:07.330814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cd705-f6bb-473f-aae9-20927f74511b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:07.391099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beffcf98-52bb-4a7d-a1ab-815bd01f2175 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:07.392168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae0567-82da-4c5f-8709-acefbe91e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:07.392823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae0567-82da-4c5f-8709-acefbe91e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:07.393100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae0567-82da-4c5f-8709-acefbe91e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:07.393373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae0567-82da-4c5f-8709-acefbe91e2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:07.437446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:07.438224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:07.438503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:07.438773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:07.439610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] RBAC: Adding query filter params (group.id=b012d16444204a71afac16a63d76721d, role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:07.439912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:07.441552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:07.453734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 186/373] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:07 2022] GET /identity/v3/role_assignments?group.id=b012d16444204a71afac16a63d76721d&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:07.454729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:07.487902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae0567-82da-4c5f-8709-acefbe91e2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:07.489394 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae0567-82da-4c5f-8709-acefbe91e2b9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:07.558921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:07.613226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 188/374] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:07.617479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:07.619664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae0567-82da-4c5f-8709-acefbe91e2b9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:07.701894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e261625-719f-446a-a9a9-f947cca2bcb9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:07.764982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67776a-3897-4518-b478-249e432de93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:07.766276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67776a-3897-4518-b478-249e432de93c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:07.766861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67776a-3897-4518-b478-249e432de93c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:07.767348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67776a-3897-4518-b478-249e432de93c None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:07.768931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67776a-3897-4518-b478-249e432de93c None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:07.770918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea67776a-3897-4518-b478-249e432de93c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:07.773073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 187/375] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:07 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:07.779550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67776a-3897-4518-b478-249e432de93c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:07.785756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae0567-82da-4c5f-8709-acefbe91e2b9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:07.833739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865fa79-e036-4a62-9b7c-559a44d7877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:07.834557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865fa79-e036-4a62-9b7c-559a44d7877d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:07.834833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865fa79-e036-4a62-9b7c-559a44d7877d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:07.835102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865fa79-e036-4a62-9b7c-559a44d7877d None admin] PATH_INFO: `/v3/projects/8c35a2b52a5945feba11f71adc84e226` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:07.837970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865fa79-e036-4a62-9b7c-559a44d7877d None admin] RBAC: Authorizing `identity:get_project(project_id=8c35a2b52a5945feba11f71adc84e226)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:07.839451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865fa79-e036-4a62-9b7c-559a44d7877d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:07.841179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 189/376] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:07 2022] GET /identity/v3/projects/8c35a2b52a5945feba11f71adc84e226 => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:07.850866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865fa79-e036-4a62-9b7c-559a44d7877d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:07.880150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:07.986034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67776a-3897-4518-b478-249e432de93c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:08.016369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865fa79-e036-4a62-9b7c-559a44d7877d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:08.024567 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a71fd9-0f77-4d20-814a-668a08ea2928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:08.025618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71fd9-0f77-4d20-814a-668a08ea2928 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.025966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71fd9-0f77-4d20-814a-668a08ea2928 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.026336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71fd9-0f77-4d20-814a-668a08ea2928 None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.027697 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a71fd9-0f77-4d20-814a-668a08ea2928 None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:08.029341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a71fd9-0f77-4d20-814a-668a08ea2928 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:08.031399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 188/377] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:07 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:08.033051 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c984f29-8b64-4459-99fd-1b8c62566cb3 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.033337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c984f29-8b64-4459-99fd-1b8c62566cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.033657 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c984f29-8b64-4459-99fd-1b8c62566cb3 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.036537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 189/378] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:08.037284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c984f29-8b64-4459-99fd-1b8c62566cb3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:08.046206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:08.094461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c4ab4-a0c6-418f-8ca1-6b12e9e6fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:08.095423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c4ab4-a0c6-418f-8ca1-6b12e9e6fb76 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.095701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c4ab4-a0c6-418f-8ca1-6b12e9e6fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.096551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c4ab4-a0c6-418f-8ca1-6b12e9e6fb76 None admin] PATH_INFO: `/v3/groups/dd82a316824b46d19008e3a4c73d1101` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.106300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c4ab4-a0c6-418f-8ca1-6b12e9e6fb76 None admin] RBAC: Authorizing `identity:get_group(group_id=dd82a316824b46d19008e3a4c73d1101)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:08.108482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c4ab4-a0c6-418f-8ca1-6b12e9e6fb76 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:08.110557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 190/379] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:07 2022] GET /identity/v3/groups/dd82a316824b46d19008e3a4c73d1101 => generated 229 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:08.112440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d061b-4eed-455b-9105-bd9cc2cdf2ac None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.112724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d061b-4eed-455b-9105-bd9cc2cdf2ac None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.112996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d061b-4eed-455b-9105-bd9cc2cdf2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.135561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b40d061b-4eed-455b-9105-bd9cc2cdf2ac None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:08.137752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b40d061b-4eed-455b-9105-bd9cc2cdf2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:08.170949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c984f29-8b64-4459-99fd-1b8c62566cb3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:08.211075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:08.212488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.212769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.213046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.213882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] RBAC: Adding query filter params (group.id=b012d16444204a71afac16a63d76721d, role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:08.214257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:08.215695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:08.222459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 190/380] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:08 2022] GET /identity/v3/role_assignments?group.id=b012d16444204a71afac16a63d76721d&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:08.223387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:08.235582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 191/381] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:08.319794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:08.338545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d061b-4eed-455b-9105-bd9cc2cdf2ac None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:08.350595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:08.389839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b42f18-c5ab-47fb-9617-5fe0a64c8c2e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:08.463355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f831b-787c-45a1-a700-b1730aaa4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:08.464166 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f831b-787c-45a1-a700-b1730aaa4e48 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.464342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f831b-787c-45a1-a700-b1730aaa4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.464585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f831b-787c-45a1-a700-b1730aaa4e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.465433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f831b-787c-45a1-a700-b1730aaa4e48 None admin] RBAC: Adding query filter params (group.id=dd82a316824b46d19008e3a4c73d1101, role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=8c35a2b52a5945feba11f71adc84e226) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:08.465740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f831b-787c-45a1-a700-b1730aaa4e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:08.467566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f831b-787c-45a1-a700-b1730aaa4e48 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:08.480794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 191/382] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:08 2022] GET /identity/v3/role_assignments?group.id=dd82a316824b46d19008e3a4c73d1101&scope.project.id=8c35a2b52a5945feba11f71adc84e226&role.id=fe643140d2134736a54afd972d47d43f => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:08.512310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d061b-4eed-455b-9105-bd9cc2cdf2ac None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:08.541275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd881-85d1-402e-8d3d-900dbac92f36 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.541604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd881-85d1-402e-8d3d-900dbac92f36 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.541814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0cd881-85d1-402e-8d3d-900dbac92f36 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.543421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 192/383] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:08.549360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19d98d-e48d-4de7-9858-83efb543ca8f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.549687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19d98d-e48d-4de7-9858-83efb543ca8f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.549901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19d98d-e48d-4de7-9858-83efb543ca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.561681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ef13-5e4c-4359-b579-4e27481870dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:08.562523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ef13-5e4c-4359-b579-4e27481870dd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.562801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ef13-5e4c-4359-b579-4e27481870dd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.563070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01ef13-5e4c-4359-b579-4e27481870dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.575199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fc19d98d-e48d-4de7-9858-83efb543ca8f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:08.576635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fc19d98d-e48d-4de7-9858-83efb543ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:08.580702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01ef13-5e4c-4359-b579-4e27481870dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ee01ef13-5e4c-4359-b579-4e27481870dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:08.589373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:08.591298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:08.592387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 192/384] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:08.597565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ef13-5e4c-4359-b579-4e27481870dd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:08.738418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:08.747759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 193/385] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:08.769731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19d98d-e48d-4de7-9858-83efb543ca8f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:08.791470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01ef13-5e4c-4359-b579-4e27481870dd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:08.838173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:08.839306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.839798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.840524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:08.841470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:08.841956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:08.844023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:08.854333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:08.856869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 193/386] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:08.863195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:08.925184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19d98d-e48d-4de7-9858-83efb543ca8f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:08.984725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122661-02ad-49cb-8aaf-1490f14359f9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:08.985731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7034-aeb7-46ed-a440-746c229f052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:08.986827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7034-aeb7-46ed-a440-746c229f052b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:08.987326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7034-aeb7-46ed-a440-746c229f052b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:08.987796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7034-aeb7-46ed-a440-746c229f052b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:09.010371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7034-aeb7-46ed-a440-746c229f052b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:09.015107 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:09.023082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb7f9-7f00-4928-843b-aa36ec0a097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:09.024491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb7f9-7f00-4928-843b-aa36ec0a097a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:09.024768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb7f9-7f00-4928-843b-aa36ec0a097a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:09.025033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb7f9-7f00-4928-843b-aa36ec0a097a None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-27cd7034-aeb7-46ed-a440-746c229f052b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:09.025806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:09.026920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:09.027932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 194/387] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:23:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:09.028754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cb7f9-7f00-4928-843b-aa36ec0a097a None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:09.031680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cb7f9-7f00-4928-843b-aa36ec0a097a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:09.031797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 194/388] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:08 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:09.035028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7034-aeb7-46ed-a440-746c229f052b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:09.043850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb7f9-7f00-4928-843b-aa36ec0a097a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:09.185135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb7f9-7f00-4928-843b-aa36ec0a097a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:09.223126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc652919-8af1-4aff-9382-b57e95c0e364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:09.224039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652919-8af1-4aff-9382-b57e95c0e364 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:09.224321 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652919-8af1-4aff-9382-b57e95c0e364 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:09.224591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc652919-8af1-4aff-9382-b57e95c0e364 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:09.225771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc652919-8af1-4aff-9382-b57e95c0e364 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:09.227328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc652919-8af1-4aff-9382-b57e95c0e364 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:09.229506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 195/389] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:09 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:09.235575 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc652919-8af1-4aff-9382-b57e95c0e364 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:09.300237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7034-aeb7-46ed-a440-746c229f052b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:09.338272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:09.354899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:09.355564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:09.355845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:09.356118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:09.356872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:09.357177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:09.358593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:09.372608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:09.380778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 195/390] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:09.395251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:09.457691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc652919-8af1-4aff-9382-b57e95c0e364 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:09.521258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714c35-00d8-4b3d-aa2d-3a7bf8aacc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:09.522922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714c35-00d8-4b3d-aa2d-3a7bf8aacc49 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:09.523435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714c35-00d8-4b3d-aa2d-3a7bf8aacc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:09.525472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714c35-00d8-4b3d-aa2d-3a7bf8aacc49 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/groups/b012d16444204a71afac16a63d76721d/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:09.530365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4714c35-00d8-4b3d-aa2d-3a7bf8aacc49 None admin] RBAC: Authorizing `identity:create_grant(project_id=66c5167fdf934ea19beeb2cb57b129e0, group_id=b012d16444204a71afac16a63d76721d, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:09.532025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4714c35-00d8-4b3d-aa2d-3a7bf8aacc49 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:09.549880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2652b5b-eeca-4e17-8129-292914b78c11 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:09.597283 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836677-91f1-4b6e-93c0-8ffd1fef76dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:09.598148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836677-91f1-4b6e-93c0-8ffd1fef76dc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:09.598428 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836677-91f1-4b6e-93c0-8ffd1fef76dc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:09.598708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836677-91f1-4b6e-93c0-8ffd1fef76dc None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:09.600305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee836677-91f1-4b6e-93c0-8ffd1fef76dc None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:09.601803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee836677-91f1-4b6e-93c0-8ffd1fef76dc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:09.603799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 196/391] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:09 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:09.608832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836677-91f1-4b6e-93c0-8ffd1fef76dc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:09.617184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 196/392] 10.222.0.70 () {58 vars in 1442 bytes} [Wed May 18 22:23:09 2022] PUT /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/groups/b012d16444204a71afac16a63d76721d/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:09.689447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:09.751058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836677-91f1-4b6e-93c0-8ffd1fef76dc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:09.793321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459ab3-1978-4081-b44a-93367fb855cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:09.794236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459ab3-1978-4081-b44a-93367fb855cd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:09.794516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459ab3-1978-4081-b44a-93367fb855cd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:09.794787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459ab3-1978-4081-b44a-93367fb855cd None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:09.798878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459ab3-1978-4081-b44a-93367fb855cd None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:09.800347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459ab3-1978-4081-b44a-93367fb855cd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:09.802392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 197/393] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:09 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:09.808813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714c35-00d8-4b3d-aa2d-3a7bf8aacc49 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:09.965182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714c35-00d8-4b3d-aa2d-3a7bf8aacc49 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:09.995020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:10.004391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecffb5-fdc9-43db-93b1-375ea5bde28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:10.005338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecffb5-fdc9-43db-93b1-375ea5bde28c None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:10.026802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecffb5-fdc9-43db-93b1-375ea5bde28c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:10.026802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecffb5-fdc9-43db-93b1-375ea5bde28c None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/groups/b012d16444204a71afac16a63d76721d/roles/6fa4573097ea4494b215fa0be868f8cd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:10.026802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecffb5-fdc9-43db-93b1-375ea5bde28c None admin] RBAC: Authorizing `identity:create_grant(project_id=66c5167fdf934ea19beeb2cb57b129e0, group_id=b012d16444204a71afac16a63d76721d, role_id=6fa4573097ea4494b215fa0be868f8cd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:10.026802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecffb5-fdc9-43db-93b1-375ea5bde28c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:10.099906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 197/394] 10.222.0.70 () {58 vars in 1442 bytes} [Wed May 18 22:23:09 2022] PUT /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0/groups/b012d16444204a71afac16a63d76721d/roles/6fa4573097ea4494b215fa0be868f8cd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:10.249355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a5a1-de05-46ff-943b-bb1045d44302 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:10.249539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a5a1-de05-46ff-943b-bb1045d44302 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:10.249815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a5a1-de05-46ff-943b-bb1045d44302 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:10.251500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 198/395] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:10.257317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8976e-d151-49af-a6e9-4f8a1264db9f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:10.257694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8976e-d151-49af-a6e9-4f8a1264db9f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:10.257977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8976e-d151-49af-a6e9-4f8a1264db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:10.286378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-98f8976e-d151-49af-a6e9-4f8a1264db9f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:10.287572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-98f8976e-d151-49af-a6e9-4f8a1264db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:10.379371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 198/396] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:10.414674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a5a1-de05-46ff-943b-bb1045d44302 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:10.563220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a5a1-de05-46ff-943b-bb1045d44302 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:10.586036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:10.610631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2479e-c5e7-43ed-b973-d61cd4505497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:10.611468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2479e-c5e7-43ed-b973-d61cd4505497 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:10.611750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2479e-c5e7-43ed-b973-d61cd4505497 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:10.612024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2479e-c5e7-43ed-b973-d61cd4505497 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:10.625385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2479e-c5e7-43ed-b973-d61cd4505497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4ef2479e-c5e7-43ed-b973-d61cd4505497 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:10.633919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:10.634916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:10.636182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 199/397] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:10.641202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8976e-d151-49af-a6e9-4f8a1264db9f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:10.774601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8976e-d151-49af-a6e9-4f8a1264db9f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:10.796818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:10.820712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e7ae6-7150-4805-9a02-320498c645c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:10.821590 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7ae6-7150-4805-9a02-320498c645c7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:10.821865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7ae6-7150-4805-9a02-320498c645c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:10.822169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e7ae6-7150-4805-9a02-320498c645c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:10.822917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e7ae6-7150-4805-9a02-320498c645c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:10.823219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e7ae6-7150-4805-9a02-320498c645c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:10.824670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e7ae6-7150-4805-9a02-320498c645c7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:10.833484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 199/398] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:10.839318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2479e-c5e7-43ed-b973-d61cd4505497 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:10.987272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e08dbe-95af-4fe5-a006-57f76c51b574 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:10.987661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e08dbe-95af-4fe5-a006-57f76c51b574 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:10.987839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e08dbe-95af-4fe5-a006-57f76c51b574 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:10.989401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 200/399] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:10.994710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64fada-40e6-4fa0-a79f-a2b4192e1000 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:10.994991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64fada-40e6-4fa0-a79f-a2b4192e1000 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:10.995263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64fada-40e6-4fa0-a79f-a2b4192e1000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.016158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2479e-c5e7-43ed-b973-d61cd4505497 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:11.016490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5a64fada-40e6-4fa0-a79f-a2b4192e1000 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:11.017578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5a64fada-40e6-4fa0-a79f-a2b4192e1000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:11.077810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aabbd-9be3-4895-bf43-a1822f6aff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:11.078618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aabbd-9be3-4895-bf43-a1822f6aff86 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:11.078899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aabbd-9be3-4895-bf43-a1822f6aff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:11.085177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aabbd-9be3-4895-bf43-a1822f6aff86 None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.085177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585aabbd-9be3-4895-bf43-a1822f6aff86 None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:11.085177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585aabbd-9be3-4895-bf43-a1822f6aff86 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:11.094104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 200/400] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:10 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:11.095023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aabbd-9be3-4895-bf43-a1822f6aff86 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:11.147649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 201/401] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:11.174354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:11.182306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64fada-40e6-4fa0-a79f-a2b4192e1000 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:11.267322 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aabbd-9be3-4895-bf43-a1822f6aff86 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:11.338175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe26dc-60eb-4867-b9ab-216d30fa115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:11.338359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64fada-40e6-4fa0-a79f-a2b4192e1000 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:11.339012 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe26dc-60eb-4867-b9ab-216d30fa115b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:11.339301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe26dc-60eb-4867-b9ab-216d30fa115b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:11.339845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe26dc-60eb-4867-b9ab-216d30fa115b None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.342813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe26dc-60eb-4867-b9ab-216d30fa115b None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:11.344260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe26dc-60eb-4867-b9ab-216d30fa115b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:11.345983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 201/402] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:11 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:11.357616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe26dc-60eb-4867-b9ab-216d30fa115b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:11.358652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:11.408643 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e457-e79a-45ad-bb31-62cefcc49f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:11.409484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e457-e79a-45ad-bb31-62cefcc49f48 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:11.409763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e457-e79a-45ad-bb31-62cefcc49f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:11.410056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e457-e79a-45ad-bb31-62cefcc49f48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.435137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e457-e79a-45ad-bb31-62cefcc49f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8e17e457-e79a-45ad-bb31-62cefcc49f48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:11.444104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:11.445076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:11.446713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 202/403] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:23:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:11.455822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e457-e79a-45ad-bb31-62cefcc49f48 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:11.566606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe26dc-60eb-4867-b9ab-216d30fa115b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:11.586338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:11.612125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced3720-6e53-464d-90d8-49844b63d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:11.612970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3720-6e53-464d-90d8-49844b63d67c None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:11.613270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3720-6e53-464d-90d8-49844b63d67c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:11.613559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3720-6e53-464d-90d8-49844b63d67c None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/groups/b012d16444204a71afac16a63d76721d/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.615777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced3720-6e53-464d-90d8-49844b63d67c None admin] RBAC: Authorizing `identity:create_grant(project_id=eacc7bad87f34a58a49e5be42278a2b2, group_id=b012d16444204a71afac16a63d76721d, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:11.616824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e457-e79a-45ad-bb31-62cefcc49f48 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:11.617220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced3720-6e53-464d-90d8-49844b63d67c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:11.655214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021ff84-154b-4c38-a100-3441efe8892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:11.656065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ff84-154b-4c38-a100-3441efe8892c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:11.656421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ff84-154b-4c38-a100-3441efe8892c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:11.656764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ff84-154b-4c38-a100-3441efe8892c None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.657598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021ff84-154b-4c38-a100-3441efe8892c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:11.658185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021ff84-154b-4c38-a100-3441efe8892c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:11.663038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021ff84-154b-4c38-a100-3441efe8892c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:11.668994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 203/404] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:11.670411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468200a-888f-44c3-bb68-462e0d1db664 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:11.670697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468200a-888f-44c3-bb68-462e0d1db664 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:11.670975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468200a-888f-44c3-bb68-462e0d1db664 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.672321 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 204/405] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:11.674284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468200a-888f-44c3-bb68-462e0d1db664 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:11.706503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:11.718054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 202/406] 10.222.0.70 () {58 vars in 1442 bytes} [Wed May 18 22:23:11 2022] PUT /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/groups/b012d16444204a71afac16a63d76721d/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:11.719716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f742a-557a-4969-a084-d526c9cd169b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:11.720171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f742a-557a-4969-a084-d526c9cd169b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:11.720815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f742a-557a-4969-a084-d526c9cd169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.743989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ca5f742a-557a-4969-a084-d526c9cd169b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:11.745950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ca5f742a-557a-4969-a084-d526c9cd169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:11.808483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468200a-888f-44c3-bb68-462e0d1db664 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:11.839937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 203/407] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:11.865015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f742a-557a-4969-a084-d526c9cd169b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:11.874757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027651-63ea-4ed4-93bb-0bc565db0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:11.875648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027651-63ea-4ed4-93bb-0bc565db0823 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:11.876017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027651-63ea-4ed4-93bb-0bc565db0823 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:11.876301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a027651-63ea-4ed4-93bb-0bc565db0823 None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:11.877556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a027651-63ea-4ed4-93bb-0bc565db0823 None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:11.879210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a027651-63ea-4ed4-93bb-0bc565db0823 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:11.890111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 205/408] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:11 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:11.896682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027651-63ea-4ed4-93bb-0bc565db0823 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:12.002526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f742a-557a-4969-a084-d526c9cd169b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:12.014152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:12.031136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:12.036381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a027651-63ea-4ed4-93bb-0bc565db0823 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:12.050672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedfbd4-7c12-401b-a9a3-ee94aef20fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:12.051600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedfbd4-7c12-401b-a9a3-ee94aef20fcf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.051791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedfbd4-7c12-401b-a9a3-ee94aef20fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.052064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedfbd4-7c12-401b-a9a3-ee94aef20fcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:12.071678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedfbd4-7c12-401b-a9a3-ee94aef20fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-deedfbd4-7c12-401b-a9a3-ee94aef20fcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:12.083517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:12.084452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:12.085641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 204/409] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:12.095025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedfbd4-7c12-401b-a9a3-ee94aef20fcf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:12.096556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f28f9-3c79-4c78-96fe-5b1db6d17515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:12.097433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f28f9-3c79-4c78-96fe-5b1db6d17515 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.097748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f28f9-3c79-4c78-96fe-5b1db6d17515 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.097987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f28f9-3c79-4c78-96fe-5b1db6d17515 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:12.100097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f28f9-3c79-4c78-96fe-5b1db6d17515 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:12.101963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f28f9-3c79-4c78-96fe-5b1db6d17515 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:12.115229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 206/410] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:11 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:12.119681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f28f9-3c79-4c78-96fe-5b1db6d17515 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:12.276861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f28f9-3c79-4c78-96fe-5b1db6d17515 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:12.339868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547bf79-f0de-4803-a000-39e6016f9fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:12.340761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bf79-f0de-4803-a000-39e6016f9fde None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.341040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bf79-f0de-4803-a000-39e6016f9fde None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.341312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547bf79-f0de-4803-a000-39e6016f9fde None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/groups/b012d16444204a71afac16a63d76721d/roles/6fa4573097ea4494b215fa0be868f8cd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:12.344313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547bf79-f0de-4803-a000-39e6016f9fde None admin] RBAC: Authorizing `identity:create_grant(project_id=eacc7bad87f34a58a49e5be42278a2b2, group_id=b012d16444204a71afac16a63d76721d, role_id=6fa4573097ea4494b215fa0be868f8cd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:12.345767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547bf79-f0de-4803-a000-39e6016f9fde None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:12.349159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedfbd4-7c12-401b-a9a3-ee94aef20fcf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:12.389973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:12.390723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.391005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.391364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:12.392079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:12.392389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:12.393813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:12.404129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 205/411] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:12.411649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:12.442453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 207/412] 10.222.0.70 () {58 vars in 1442 bytes} [Wed May 18 22:23:12 2022] PUT /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2/groups/b012d16444204a71afac16a63d76721d/roles/6fa4573097ea4494b215fa0be868f8cd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:12.450485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:12.532564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa5556-ea38-4e9c-a07c-b88bc071292d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:12.592559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7f144-3f0c-4d9a-9386-88ff039f0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:12.593444 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f144-3f0c-4d9a-9386-88ff039f0823 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.593727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f144-3f0c-4d9a-9386-88ff039f0823 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.594021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f144-3f0c-4d9a-9386-88ff039f0823 None admin] PATH_INFO: `/v3/groups/dd82a316824b46d19008e3a4c73d1101` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:12.595289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f144-3f0c-4d9a-9386-88ff039f0823 None admin] RBAC: Authorizing `identity:get_group(group_id=dd82a316824b46d19008e3a4c73d1101)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:12.596866 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f144-3f0c-4d9a-9386-88ff039f0823 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:12.598791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 206/413] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:12 2022] GET /identity/v3/groups/dd82a316824b46d19008e3a4c73d1101 => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:12.605019 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547bf79-f0de-4803-a000-39e6016f9fde None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:12.641704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:12.737577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547bf79-f0de-4803-a000-39e6016f9fde None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:12.747604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd43bf-9369-499f-a90e-2fbdf2823ce6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.747881 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd43bf-9369-499f-a90e-2fbdf2823ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.748156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd43bf-9369-499f-a90e-2fbdf2823ce6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:12.749940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 207/414] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:12.755250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdebbbf-c3ab-46de-be3e-62cb0f94c3b8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.755540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdebbbf-c3ab-46de-be3e-62cb0f94c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.755818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdebbbf-c3ab-46de-be3e-62cb0f94c3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:12.778559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ebdebbbf-c3ab-46de-be3e-62cb0f94c3b8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:12.779758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ebdebbbf-c3ab-46de-be3e-62cb0f94c3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:12.782246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c75749-f9ea-4f72-9ced-b2e63a66472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:12.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c75749-f9ea-4f72-9ced-b2e63a66472d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.784259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c75749-f9ea-4f72-9ced-b2e63a66472d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.784534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c75749-f9ea-4f72-9ced-b2e63a66472d None admin] PATH_INFO: `/v3/projects/8c35a2b52a5945feba11f71adc84e226` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:12.787034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c75749-f9ea-4f72-9ced-b2e63a66472d None admin] RBAC: Authorizing `identity:get_project(project_id=8c35a2b52a5945feba11f71adc84e226)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:12.788936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c75749-f9ea-4f72-9ced-b2e63a66472d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:12.792032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 208/415] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:12 2022] GET /identity/v3/projects/8c35a2b52a5945feba11f71adc84e226 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:12.796856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c75749-f9ea-4f72-9ced-b2e63a66472d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:12.862115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 208/416] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:12.887942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdebbbf-c3ab-46de-be3e-62cb0f94c3b8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:12.922550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:12.926642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:12.937695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c75749-f9ea-4f72-9ced-b2e63a66472d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:12.995458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2897a-82bb-4855-8a07-e73d11d65b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:12.996354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2897a-82bb-4855-8a07-e73d11d65b33 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:12.996687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2897a-82bb-4855-8a07-e73d11d65b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:12.996956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2897a-82bb-4855-8a07-e73d11d65b33 None admin] PATH_INFO: `/v3/projects/8c35a2b52a5945feba11f71adc84e226/groups/dd82a316824b46d19008e3a4c73d1101/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.002705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2897a-82bb-4855-8a07-e73d11d65b33 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c35a2b52a5945feba11f71adc84e226, group_id=dd82a316824b46d19008e3a4c73d1101, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:13.003604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdebbbf-c3ab-46de-be3e-62cb0f94c3b8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:13.004305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2897a-82bb-4855-8a07-e73d11d65b33 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:13.040109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa734f-ddb2-4a4f-8e83-83941dc23ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:13.041141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa734f-ddb2-4a4f-8e83-83941dc23ccd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:13.041582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa734f-ddb2-4a4f-8e83-83941dc23ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:13.042032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa734f-ddb2-4a4f-8e83-83941dc23ccd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.052978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fa734f-ddb2-4a4f-8e83-83941dc23ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a3fa734f-ddb2-4a4f-8e83-83941dc23ccd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:13.062040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:13.063265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:13.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:13.067371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 209/417] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:13.074427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa734f-ddb2-4a4f-8e83-83941dc23ccd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:13.097826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 209/418] 10.222.0.70 () {58 vars in 1442 bytes} [Wed May 18 22:23:12 2022] PUT /identity/v3/projects/8c35a2b52a5945feba11f71adc84e226/groups/dd82a316824b46d19008e3a4c73d1101/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:13.106249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913dbb-de14-493d-bb36-12991d6f8e17 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:13.106249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913dbb-de14-493d-bb36-12991d6f8e17 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:13.106249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44913dbb-de14-493d-bb36-12991d6f8e17 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.106249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 210/419] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:13.107642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488e08-6982-494a-b188-27a2d6d4c443 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:13.107926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488e08-6982-494a-b188-27a2d6d4c443 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:13.108206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488e08-6982-494a-b188-27a2d6d4c443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.127657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-97488e08-6982-494a-b188-27a2d6d4c443 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:13.128914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-97488e08-6982-494a-b188-27a2d6d4c443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:13.209828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 211/420] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:13.235785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97488e08-6982-494a-b188-27a2d6d4c443 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:13.243916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:13.270216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa734f-ddb2-4a4f-8e83-83941dc23ccd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:13.307921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:13.308587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:13.308862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:13.309131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.309885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:13.310214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:13.311610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:13.321583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 210/421] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:13.331353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:13.338552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:13.357554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97488e08-6982-494a-b188-27a2d6d4c443 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:13.407437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594490-d7aa-49e2-a65d-db26f2629ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:13.408633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594490-d7aa-49e2-a65d-db26f2629ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:13.409240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594490-d7aa-49e2-a65d-db26f2629ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:13.409814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594490-d7aa-49e2-a65d-db26f2629ac3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.430845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594490-d7aa-49e2-a65d-db26f2629ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d5594490-d7aa-49e2-a65d-db26f2629ac3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:13.456032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:13.456998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:13.457811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 212/422] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:23:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:13.463678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594490-d7aa-49e2-a65d-db26f2629ac3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:13.469244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ff78b-4885-4bd2-83e7-3a1b621c3711 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:13.516239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21147b15-7383-4104-a765-08d71443d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:13.516875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147b15-7383-4104-a765-08d71443d744 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:13.517159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147b15-7383-4104-a765-08d71443d744 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:13.517427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147b15-7383-4104-a765-08d71443d744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.538596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:13.584185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594490-d7aa-49e2-a65d-db26f2629ac3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:13.596714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21147b15-7383-4104-a765-08d71443d744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:13.598241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21147b15-7383-4104-a765-08d71443d744 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:13.663296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:13.663975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:13.664256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:13.664591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.665536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:13.665846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:13.667295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:13.696457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 213/423] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:13.702244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:13.705741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 211/424] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:13.710916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21147b15-7383-4104-a765-08d71443d744 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:13.724365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:13.782376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:13.829452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21147b15-7383-4104-a765-08d71443d744 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:13.865346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f783a89-9b50-45e6-beb6-85671bc3a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:13.866227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f783a89-9b50-45e6-beb6-85671bc3a045 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:13.866747 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f783a89-9b50-45e6-beb6-85671bc3a045 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:13.867115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f783a89-9b50-45e6-beb6-85671bc3a045 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:13.868583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f783a89-9b50-45e6-beb6-85671bc3a045 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:13.870142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f783a89-9b50-45e6-beb6-85671bc3a045 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:13.872396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 212/425] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:13 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:13.877423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f783a89-9b50-45e6-beb6-85671bc3a045 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:13.957808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3b5f6-bd95-48fd-beb2-27c5711cfe2a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:14.002025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef01db-b675-40ce-9f26-d2a25a90e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:14.003075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef01db-b675-40ce-9f26-d2a25a90e890 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.003555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef01db-b675-40ce-9f26-d2a25a90e890 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.004026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef01db-b675-40ce-9f26-d2a25a90e890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.015487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f783a89-9b50-45e6-beb6-85671bc3a045 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:14.036746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:14.054101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b49da8-b343-4220-bffa-6bfebea4d4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:14.055006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49da8-b343-4220-bffa-6bfebea4d4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.055260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49da8-b343-4220-bffa-6bfebea4d4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.055608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49da8-b343-4220-bffa-6bfebea4d4b3 None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.066494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b49da8-b343-4220-bffa-6bfebea4d4b3 None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:14.066494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b49da8-b343-4220-bffa-6bfebea4d4b3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:14.066494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 213/426] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:13 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:14.066494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b49da8-b343-4220-bffa-6bfebea4d4b3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:14.135088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef01db-b675-40ce-9f26-d2a25a90e890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:14.136642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef01db-b675-40ce-9f26-d2a25a90e890 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:14.151254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:14.174673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b49da8-b343-4220-bffa-6bfebea4d4b3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:14.213686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:14.214851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.215358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.215806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.216839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] RBAC: Adding query filter params (group.id=b012d16444204a71afac16a63d76721d, role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:14.217369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:14.219277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:14.226810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 214/427] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:14 2022] GET /identity/v3/role_assignments?group.id=b012d16444204a71afac16a63d76721d&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:14.311826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 214/428] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 22:23:14.317569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:14.371360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:14.429245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42940fd9-00fb-45fd-ba4b-7628f754ed41 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:14.443583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407f5b2-3e7e-4ad8-9f5f-7993140dc07f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.443850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407f5b2-3e7e-4ad8-9f5f-7993140dc07f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.444273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407f5b2-3e7e-4ad8-9f5f-7993140dc07f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.446667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 215/429] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:14.452894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fec5-d0c2-46e4-8748-f5fd1b6dc695 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.453173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fec5-d0c2-46e4-8748-f5fd1b6dc695 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.453586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1fec5-d0c2-46e4-8748-f5fd1b6dc695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.471580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6d1ef-cd33-4b00-aa01-9bf3d06c9189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:14.472741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d1ef-cd33-4b00-aa01-9bf3d06c9189 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.473189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d1ef-cd33-4b00-aa01-9bf3d06c9189 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.473708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d1ef-cd33-4b00-aa01-9bf3d06c9189 None admin] PATH_INFO: `/v3/projects/66c5167fdf934ea19beeb2cb57b129e0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.475186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6d1ef-cd33-4b00-aa01-9bf3d06c9189 None admin] RBAC: Authorizing `identity:get_project(project_id=66c5167fdf934ea19beeb2cb57b129e0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:14.476788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6d1ef-cd33-4b00-aa01-9bf3d06c9189 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:14.480127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 215/430] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:14 2022] GET /identity/v3/projects/66c5167fdf934ea19beeb2cb57b129e0 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:14.485702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6d1ef-cd33-4b00-aa01-9bf3d06c9189 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:14.490396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d3a1fec5-d0c2-46e4-8748-f5fd1b6dc695 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:14.491043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d3a1fec5-d0c2-46e4-8748-f5fd1b6dc695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:14.590425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 216/431] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:14.596565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6d1ef-cd33-4b00-aa01-9bf3d06c9189 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:14.614251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:14.615607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1fec5-d0c2-46e4-8748-f5fd1b6dc695 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:14.633752 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d28689-c93f-4938-97f8-d016a472689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:14.634642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d28689-c93f-4938-97f8-d016a472689e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.634919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d28689-c93f-4938-97f8-d016a472689e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.635189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d28689-c93f-4938-97f8-d016a472689e None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.636386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d28689-c93f-4938-97f8-d016a472689e None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:14.637964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d28689-c93f-4938-97f8-d016a472689e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:14.640018 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 216/432] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:14 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:14.645553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d28689-c93f-4938-97f8-d016a472689e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:14.661098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:14.741633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1fec5-d0c2-46e4-8748-f5fd1b6dc695 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:14.758925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d28689-c93f-4938-97f8-d016a472689e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:14.784068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482af7e-7a3e-4374-8947-7b47d77e4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:14.784868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482af7e-7a3e-4374-8947-7b47d77e4836 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.785247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482af7e-7a3e-4374-8947-7b47d77e4836 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.785528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482af7e-7a3e-4374-8947-7b47d77e4836 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.798419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:14.798820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482af7e-7a3e-4374-8947-7b47d77e4836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:14.799072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:14.799350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:14.799624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:14.800458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] RBAC: Adding query filter params (group.id=b012d16444204a71afac16a63d76721d, role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=66c5167fdf934ea19beeb2cb57b129e0) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:14.800764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:14.802375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:14.809532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 217/433] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:14 2022] GET /identity/v3/role_assignments?group.id=b012d16444204a71afac16a63d76721d&scope.project.id=66c5167fdf934ea19beeb2cb57b129e0&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9482af7e-7a3e-4374-8947-7b47d77e4836 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:14.810232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:14.811101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:14.811915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 217/434] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:14.819208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:14.892011 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:14.969219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaa6b4-f8c0-4e15-9c3f-55f50bb0b874 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:15.016114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b24f0e-a33e-45ae-ad6e-7e1fa5284404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:15.016788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b24f0e-a33e-45ae-ad6e-7e1fa5284404 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.017071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b24f0e-a33e-45ae-ad6e-7e1fa5284404 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.017347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b24f0e-a33e-45ae-ad6e-7e1fa5284404 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.018138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b24f0e-a33e-45ae-ad6e-7e1fa5284404 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:15.018447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b24f0e-a33e-45ae-ad6e-7e1fa5284404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:15.019913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b24f0e-a33e-45ae-ad6e-7e1fa5284404 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:15.030077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 218/435] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:23:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:15.035740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482af7e-7a3e-4374-8947-7b47d77e4836 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:15.164007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:15.171054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482af7e-7a3e-4374-8947-7b47d77e4836 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:15.214429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41ca9d-6d9c-48af-b893-c39860f5d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:15.215435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41ca9d-6d9c-48af-b893-c39860f5d9fe None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.215707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41ca9d-6d9c-48af-b893-c39860f5d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.215974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41ca9d-6d9c-48af-b893-c39860f5d9fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.279193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810196fa-e709-4ef5-bd87-6c07c3944bbb None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.279493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810196fa-e709-4ef5-bd87-6c07c3944bbb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.279746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810196fa-e709-4ef5-bd87-6c07c3944bbb None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.281231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 219/436] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:15.286907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41ca9d-6d9c-48af-b893-c39860f5d9fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:15.288413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41ca9d-6d9c-48af-b893-c39860f5d9fe None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:15.289219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674bf39-4d65-4380-af43-3c932416cd85 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.289519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674bf39-4d65-4380-af43-3c932416cd85 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.289799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674bf39-4d65-4380-af43-3c932416cd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.311228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5674bf39-4d65-4380-af43-3c932416cd85 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:15.315013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5674bf39-4d65-4380-af43-3c932416cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:15.400972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:15.407311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 218/437] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:15.410756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 220/438] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:15.415622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41ca9d-6d9c-48af-b893-c39860f5d9fe None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:15.435280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674bf39-4d65-4380-af43-3c932416cd85 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:15.494671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:15.531451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41ca9d-6d9c-48af-b893-c39860f5d9fe None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:15.554721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674bf39-4d65-4380-af43-3c932416cd85 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:15.566952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2fe6-3428-416e-9f29-22c368e13ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:15.567813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2fe6-3428-416e-9f29-22c368e13ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.568354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2fe6-3428-416e-9f29-22c368e13ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.568620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e2fe6-3428-416e-9f29-22c368e13ca6 None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.569805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2fe6-3428-416e-9f29-22c368e13ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:15.571308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e2fe6-3428-416e-9f29-22c368e13ca6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:15.577257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 219/439] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:15 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:15.578216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2fe6-3428-416e-9f29-22c368e13ca6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:15.597120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d3362-e011-4a19-82df-991077b593b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:15.597926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3362-e011-4a19-82df-991077b593b7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.598232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3362-e011-4a19-82df-991077b593b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.598507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d3362-e011-4a19-82df-991077b593b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.610306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d3362-e011-4a19-82df-991077b593b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-cd4d3362-e011-4a19-82df-991077b593b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:15.618984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:15.620328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:15.621192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 221/440] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:23:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:15.626050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d3362-e011-4a19-82df-991077b593b7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:15.644621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:15.683799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e2fe6-3428-416e-9f29-22c368e13ca6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:15.720632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46484469-29d1-4c48-bfc9-f6a056a5862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:15.721494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46484469-29d1-4c48-bfc9-f6a056a5862d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.721758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46484469-29d1-4c48-bfc9-f6a056a5862d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.722048 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46484469-29d1-4c48-bfc9-f6a056a5862d None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.723339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46484469-29d1-4c48-bfc9-f6a056a5862d None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:15.725071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46484469-29d1-4c48-bfc9-f6a056a5862d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:15.731984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 220/441] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:15 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:15.732947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46484469-29d1-4c48-bfc9-f6a056a5862d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:15.738168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:15.741087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d3362-e011-4a19-82df-991077b593b7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:15.783168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:15.784203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.784695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.785207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.786035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:15.786395 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:15.787763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:15.802035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 222/442] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:15.807436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:15.853608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46484469-29d1-4c48-bfc9-f6a056a5862d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:15.884903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:15.889955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147050d-e00f-4e51-8917-987781b4eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:15.890277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147050d-e00f-4e51-8917-987781b4eefe None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.890560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147050d-e00f-4e51-8917-987781b4eefe None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.890835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147050d-e00f-4e51-8917-987781b4eefe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.891664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147050d-e00f-4e51-8917-987781b4eefe None admin] RBAC: Adding query filter params (group.id=b012d16444204a71afac16a63d76721d, role.id=a080c6e46ea94d0792cb2cb7c51b4f65, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:15.891981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147050d-e00f-4e51-8917-987781b4eefe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:15.893425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147050d-e00f-4e51-8917-987781b4eefe None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:15.900119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 221/443] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:15 2022] GET /identity/v3/role_assignments?group.id=b012d16444204a71afac16a63d76721d&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=a080c6e46ea94d0792cb2cb7c51b4f65 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:15.921048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64814a5-8980-449f-9dc6-99f77871545d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:15.933685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f070b-a8d2-488a-a373-bc1ef167cdfe None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.934098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f070b-a8d2-488a-a373-bc1ef167cdfe None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.934276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f070b-a8d2-488a-a373-bc1ef167cdfe None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.935865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 222/444] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:15.941644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11291185-392a-49e5-8a7f-70065522daac None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.941949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11291185-392a-49e5-8a7f-70065522daac None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.942226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11291185-392a-49e5-8a7f-70065522daac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:15.965990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-11291185-392a-49e5-8a7f-70065522daac None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:15.967885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-11291185-392a-49e5-8a7f-70065522daac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:15.993532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4cbd6-88f6-4e06-a470-571431a07e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:15.994406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4cbd6-88f6-4e06-a470-571431a07e22 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:15.994791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4cbd6-88f6-4e06-a470-571431a07e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:15.995172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4cbd6-88f6-4e06-a470-571431a07e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:16.030071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:16.071722 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 223/445] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:16.077930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4cbd6-88f6-4e06-a470-571431a07e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:16.079566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4cbd6-88f6-4e06-a470-571431a07e22 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:16.085328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11291185-392a-49e5-8a7f-70065522daac None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:16.212516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 223/446] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 22:23:16.218426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4cbd6-88f6-4e06-a470-571431a07e22 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:16.230143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11291185-392a-49e5-8a7f-70065522daac None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:16.271261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:16.279628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fcdd9-f454-4abe-b4e3-2c549c8b19ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:16.280742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fcdd9-f454-4abe-b4e3-2c549c8b19ca None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:16.281030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fcdd9-f454-4abe-b4e3-2c549c8b19ca None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:16.281377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fcdd9-f454-4abe-b4e3-2c549c8b19ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:16.293966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fcdd9-f454-4abe-b4e3-2c549c8b19ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:16.301778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-543fcdd9-f454-4abe-b4e3-2c549c8b19ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:16.307715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:16.308636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:16.309449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:16.310127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 224/447] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:16.318966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fcdd9-f454-4abe-b4e3-2c549c8b19ca None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:16.348638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4cbd6-88f6-4e06-a470-571431a07e22 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:16.383392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac6a8-1409-40cd-ab8e-fc7c0ab61bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:16.384240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac6a8-1409-40cd-ab8e-fc7c0ab61bdf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:16.384516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac6a8-1409-40cd-ab8e-fc7c0ab61bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:16.384790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac6a8-1409-40cd-ab8e-fc7c0ab61bdf None admin] PATH_INFO: `/v3/projects/eacc7bad87f34a58a49e5be42278a2b2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:16.385962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac6a8-1409-40cd-ab8e-fc7c0ab61bdf None admin] RBAC: Authorizing `identity:get_project(project_id=eacc7bad87f34a58a49e5be42278a2b2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:16.387425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac6a8-1409-40cd-ab8e-fc7c0ab61bdf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:16.389108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 224/448] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:16 2022] GET /identity/v3/projects/eacc7bad87f34a58a49e5be42278a2b2 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:16.394387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac6a8-1409-40cd-ab8e-fc7c0ab61bdf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:16.427607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fcdd9-f454-4abe-b4e3-2c549c8b19ca None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:16.460902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:16.461794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:16.462105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:16.462380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:16.463170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:16.463429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:16.464804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:16.472667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 225/449] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:16.478609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:16.493137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac6a8-1409-40cd-ab8e-fc7c0ab61bdf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:16.521149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:16.526661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:16.527110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dc569-1d31-4218-9795-299197fdf155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:16.530057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dc569-1d31-4218-9795-299197fdf155 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:16.530057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dc569-1d31-4218-9795-299197fdf155 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:16.530057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150dc569-1d31-4218-9795-299197fdf155 None admin] PATH_INFO: `/v3/groups/b012d16444204a71afac16a63d76721d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:16.530057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dc569-1d31-4218-9795-299197fdf155 None admin] RBAC: Authorizing `identity:get_group(group_id=b012d16444204a71afac16a63d76721d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:16.531156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150dc569-1d31-4218-9795-299197fdf155 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:16.532841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 225/450] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:16 2022] GET /identity/v3/groups/b012d16444204a71afac16a63d76721d => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:16.538537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dc569-1d31-4218-9795-299197fdf155 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:16.579276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadfa59-9fd4-4f5a-8df1-1a24ff5e609e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:16.613541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5d707-9774-4fbe-9e80-0609ef9a8d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:16.614210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d707-9774-4fbe-9e80-0609ef9a8d5b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:16.614492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d707-9774-4fbe-9e80-0609ef9a8d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:16.614807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5d707-9774-4fbe-9e80-0609ef9a8d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:16.639051 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150dc569-1d31-4218-9795-299197fdf155 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:16.673466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:16.674113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:16.674399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:16.674673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:16.675486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] RBAC: Adding query filter params (group.id=b012d16444204a71afac16a63d76721d, role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=eacc7bad87f34a58a49e5be42278a2b2) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:16.675792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:16.677199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:16.681512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5d707-9774-4fbe-9e80-0609ef9a8d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:16.682986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5d707-9774-4fbe-9e80-0609ef9a8d5b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:16.683293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 226/451] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:16 2022] GET /identity/v3/role_assignments?group.id=b012d16444204a71afac16a63d76721d&scope.project.id=eacc7bad87f34a58a49e5be42278a2b2&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:16.738097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:16.792235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 226/452] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 22:23:16.797937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:16.863339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:16.904120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022652-a175-4c0f-bf3b-44916ca70e05 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:16.938177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b22d-e67d-4e67-b44e-975f615747db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:16.939034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b22d-e67d-4e67-b44e-975f615747db None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:16.939316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b22d-e67d-4e67-b44e-975f615747db None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:16.939591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b22d-e67d-4e67-b44e-975f615747db None admin] PATH_INFO: `/v3/projects/8c35a2b52a5945feba11f71adc84e226` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:16.940777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93b22d-e67d-4e67-b44e-975f615747db None admin] RBAC: Authorizing `identity:get_project(project_id=8c35a2b52a5945feba11f71adc84e226)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:16.942288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93b22d-e67d-4e67-b44e-975f615747db None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:16.944435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 227/453] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:23:16 2022] GET /identity/v3/projects/8c35a2b52a5945feba11f71adc84e226 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:16.950515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5d707-9774-4fbe-9e80-0609ef9a8d5b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:17.061255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5d707-9774-4fbe-9e80-0609ef9a8d5b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:17.096466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9e6a2-d4cc-4b65-9851-4f27dd5b4cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:17.097322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9e6a2-d4cc-4b65-9851-4f27dd5b4cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:17.097600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9e6a2-d4cc-4b65-9851-4f27dd5b4cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:17.097924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9e6a2-d4cc-4b65-9851-4f27dd5b4cd5 None admin] PATH_INFO: `/v3/groups/dd82a316824b46d19008e3a4c73d1101` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:17.099176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9e6a2-d4cc-4b65-9851-4f27dd5b4cd5 None admin] RBAC: Authorizing `identity:get_group(group_id=dd82a316824b46d19008e3a4c73d1101)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:17.100607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b9e6a2-d4cc-4b65-9851-4f27dd5b4cd5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:17.102506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 227/454] 10.222.0.70 () {56 vars in 1180 bytes} [Wed May 18 22:23:16 2022] GET /identity/v3/groups/dd82a316824b46d19008e3a4c73d1101 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:17.108070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b22d-e67d-4e67-b44e-975f615747db None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:17.206196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b22d-e67d-4e67-b44e-975f615747db None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:17.234320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:17.239782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2054-4f1d-4b6f-835d-ce3802481960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:17.240411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2054-4f1d-4b6f-835d-ce3802481960 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:17.240694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2054-4f1d-4b6f-835d-ce3802481960 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:17.240969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2054-4f1d-4b6f-835d-ce3802481960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:17.241788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f2054-4f1d-4b6f-835d-ce3802481960 None admin] RBAC: Adding query filter params (group.id=dd82a316824b46d19008e3a4c73d1101, role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=8c35a2b52a5945feba11f71adc84e226) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:17.242129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f2054-4f1d-4b6f-835d-ce3802481960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:17.244152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f2054-4f1d-4b6f-835d-ce3802481960 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:17.249793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 228/455] 10.222.0.70 () {56 vars in 1376 bytes} [Wed May 18 22:23:17 2022] GET /identity/v3/role_assignments?group.id=dd82a316824b46d19008e3a4c73d1101&scope.project.id=8c35a2b52a5945feba11f71adc84e226&role.id=fe643140d2134736a54afd972d47d43f => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:20.002467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc590-7337-4b9e-930b-ebb1e2d01b17 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.002999 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc590-7337-4b9e-930b-ebb1e2d01b17 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.002999 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dc590-7337-4b9e-930b-ebb1e2d01b17 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.004625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 228/456] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:20.016197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8511f-42a7-43e1-8341-d9563da3c195 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.016711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8511f-42a7-43e1-8341-d9563da3c195 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.016711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8511f-42a7-43e1-8341-d9563da3c195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.046071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f0c8511f-42a7-43e1-8341-d9563da3c195 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:20.046071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f0c8511f-42a7-43e1-8341-d9563da3c195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:20.147871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 229/457] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:20.183689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dc590-7337-4b9e-930b-ebb1e2d01b17 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:20.206045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:20.261519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777dff2-39dd-4532-98ba-d4ae164e5dce None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.261715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777dff2-39dd-4532-98ba-d4ae164e5dce None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.261983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777dff2-39dd-4532-98ba-d4ae164e5dce None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.263627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 230/458] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:20.277884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c20d-926f-40d0-a90e-18ccc995badb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.278204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c20d-926f-40d0-a90e-18ccc995badb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.278483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c20d-926f-40d0-a90e-18ccc995badb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.309105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8c54c20d-926f-40d0-a90e-18ccc995badb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:20.310320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8c54c20d-926f-40d0-a90e-18ccc995badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:20.317247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dc590-7337-4b9e-930b-ebb1e2d01b17 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:20.365549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:20.366830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.367635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.368102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.382519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:20.384255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:20.386313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 231/459] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:20.391185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260776-ce42-48cc-b3ee-ec56a93541dd None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.391185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260776-ce42-48cc-b3ee-ec56a93541dd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.391185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa260776-ce42-48cc-b3ee-ec56a93541dd None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.391185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 232/460] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:20.394779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d354d9-f09f-4c43-b014-874bf1be5ba7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.395268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d354d9-f09f-4c43-b014-874bf1be5ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.395733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d354d9-f09f-4c43-b014-874bf1be5ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.414383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-97d354d9-f09f-4c43-b014-874bf1be5ba7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:20.416387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-97d354d9-f09f-4c43-b014-874bf1be5ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:20.426454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:20.427336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:20.428196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:20.428196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:20.428196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:20.428196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:20.428196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 229/461] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:20.429478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:20.483146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:20.504999 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:20.507063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 233/462] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:20.507953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d354d9-f09f-4c43-b014-874bf1be5ba7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:20.555655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bc4e7-6fce-4874-8cf2-a40f5729ea7a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:20.608528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:20.609939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.610825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.611294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.626179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:20.627365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d354d9-f09f-4c43-b014-874bf1be5ba7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:20.628206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:20.652318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:20.653220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:20.654144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:20.654144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:20.654144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:20.654144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:20.655495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 230/463] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:20.656116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:20.671029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:20.672337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.672820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.673309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.674847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:20.675351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:20.677420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:20.700833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 234/464] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:20.701599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:20.752396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:20.777875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113f66e-b876-45bc-9ffb-f242c65cb8a5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:20.799794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:20.812185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce547a17-b6d6-44a9-b4a8-ef9347676b2b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:20.814563 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:20.816231 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.816518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.816798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.829209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:20.831152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:20.849312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:20.850270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:20.851130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:20.851130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:20.851130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:20.851130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:20.851130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 231/465] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:20.851393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:20.853280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e307-ce5c-481d-a7ba-067837124ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:20.853933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e307-ce5c-481d-a7ba-067837124ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.854244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e307-ce5c-481d-a7ba-067837124ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.854527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e307-ce5c-481d-a7ba-067837124ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.855245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e307-ce5c-481d-a7ba-067837124ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:20.855551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e307-ce5c-481d-a7ba-067837124ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:20.857357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e307-ce5c-481d-a7ba-067837124ad1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:20.870706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 235/466] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:20.876200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538507-3d36-4fdf-aaa0-e2d393768f24 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:20.876494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538507-3d36-4fdf-aaa0-e2d393768f24 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:20.876785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538507-3d36-4fdf-aaa0-e2d393768f24 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:20.878062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 236/467] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:20.878762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538507-3d36-4fdf-aaa0-e2d393768f24 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:20.969038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9333e9-ccd6-4256-87f4-c4f729a1da16 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:20.988310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538507-3d36-4fdf-aaa0-e2d393768f24 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:20.991756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:21.006149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e62c3-c900-42e0-b3b3-27a2e8688376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:21.007436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e62c3-c900-42e0-b3b3-27a2e8688376 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.007864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e62c3-c900-42e0-b3b3-27a2e8688376 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.008305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e62c3-c900-42e0-b3b3-27a2e8688376 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.009247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e62c3-c900-42e0-b3b3-27a2e8688376 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:21.010885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e62c3-c900-42e0-b3b3-27a2e8688376 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:21.024931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:21.025617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.025898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.026205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.026923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:21.027227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:21.028579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:21.040335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 237/468] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:21.041067 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:21.105944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 232/469] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:23:20 2022] POST /identity/v3/users => generated 248 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:21.108339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f8c67-a087-41d4-af93-d3f39105832d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.108821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f8c67-a087-41d4-af93-d3f39105832d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.109203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f8c67-a087-41d4-af93-d3f39105832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.136111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7f7f8c67-a087-41d4-af93-d3f39105832d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:21.138306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7f7f8c67-a087-41d4-af93-d3f39105832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:21.167874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df284a88-3bcd-4b67-9f5b-5c4cfa1e5595 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:21.173794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:21.213921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1900ba-ae36-4966-b4c9-38b2c17960d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:21.214956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1900ba-ae36-4966-b4c9-38b2c17960d3 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.215521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1900ba-ae36-4966-b4c9-38b2c17960d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.215973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1900ba-ae36-4966-b4c9-38b2c17960d3 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.216870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1900ba-ae36-4966-b4c9-38b2c17960d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:21.218557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1900ba-ae36-4966-b4c9-38b2c17960d3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:21.242057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 233/470] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:21.242057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f8c67-a087-41d4-af93-d3f39105832d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:21.300095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 238/471] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:23:21 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:21.300951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1900ba-ae36-4966-b4c9-38b2c17960d3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:21.332027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:21.379617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f8c67-a087-41d4-af93-d3f39105832d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:21.423816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef4edc-db10-4615-aaea-70b42c362086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:21.424780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4edc-db10-4615-aaea-70b42c362086 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.425241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4edc-db10-4615-aaea-70b42c362086 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.425711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef4edc-db10-4615-aaea-70b42c362086 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.426621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef4edc-db10-4615-aaea-70b42c362086 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:21.428262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef4edc-db10-4615-aaea-70b42c362086 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:21.443774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1900ba-ae36-4966-b4c9-38b2c17960d3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:21.481689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261f73-fc6a-4b1b-94c0-c3976727f76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:21.482503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261f73-fc6a-4b1b-94c0-c3976727f76f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.482782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261f73-fc6a-4b1b-94c0-c3976727f76f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.483056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261f73-fc6a-4b1b-94c0-c3976727f76f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.496831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261f73-fc6a-4b1b-94c0-c3976727f76f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:21.498491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261f73-fc6a-4b1b-94c0-c3976727f76f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-95261f73-fc6a-4b1b-94c0-c3976727f76f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:21.518585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:21.519569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:21.520494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:21.520494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:21.520494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:21.520494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:21.520494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 239/472] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:21.521934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3520ec-ed66-49e8-847a-fd472c07881a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.521934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3520ec-ed66-49e8-847a-fd472c07881a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.521934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3520ec-ed66-49e8-847a-fd472c07881a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.523069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 240/473] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:21.528344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3520ec-ed66-49e8-847a-fd472c07881a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:21.534348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 234/474] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:23:21 2022] POST /identity/v3/users => generated 248 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:21.534348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07932-2c2d-4d48-839d-ce141495868b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.534348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07932-2c2d-4d48-839d-ce141495868b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.534348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07932-2c2d-4d48-839d-ce141495868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.551609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2af07932-2c2d-4d48-839d-ce141495868b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:21.552877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2af07932-2c2d-4d48-839d-ce141495868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:21.565271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:21.636406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:21.656451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 235/475] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:21.678440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3520ec-ed66-49e8-847a-fd472c07881a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:21.679216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07932-2c2d-4d48-839d-ce141495868b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:21.726043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:21.727550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.728055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.728511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.730081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:21.730573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:21.732603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:21.750611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 241/476] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:21.756773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:21.811853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07932-2c2d-4d48-839d-ce141495868b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:21.860226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:21.861157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.861582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.862907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.863831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:21.865366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:21.888028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b9f3a-0e4c-4692-81af-4e8a30b96947 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:21.893115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.sql.core [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 22:23:21.893115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 18 22:23:21.893115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [parameters: {'id': '342921bf84674ab0af635ea64c8b25b5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 18 22:23:21.893115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80364) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 18 22:23:21.917956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return ref.to_dict() May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 22:23:21.919068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application yield resource May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.rollback() May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.force_reraise() May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise self.value May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application session.commit() May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 22:23:21.920225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._prepare_impl() May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.flush() May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._flush(objects) May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application compat.raise_( May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application flush_context.execute() May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rec.execute(self) May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 22:23:21.921302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application c = connection._execute_20( May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 22:23:21.922424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 22:23:21.923432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [parameters: {'id': '342921bf84674ab0af635ea64c8b25b5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:21.924624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 18 22:23:21.925657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:21.929307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 236/477] 10.222.0.70 () {60 vars in 1131 bytes} [Wed May 18 22:23:21 2022] POST /identity/v3/roles => generated 144 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:21.934932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:21.935982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:21.951790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff82ef6-4dcb-4862-ba42-c1f8dd4a6663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:21.952464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82ef6-4dcb-4862-ba42-c1f8dd4a6663 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:21.952744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82ef6-4dcb-4862-ba42-c1f8dd4a6663 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:21.953015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff82ef6-4dcb-4862-ba42-c1f8dd4a6663 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:21.953735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff82ef6-4dcb-4862-ba42-c1f8dd4a6663 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:21.955229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff82ef6-4dcb-4862-ba42-c1f8dd4a6663 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:21.956761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:22.028937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 242/478] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:23:21 2022] POST /identity/v3/users => generated 249 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:23:22.095846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d495e-e35f-4072-93d2-c136d396bdcb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:22.145078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4e65d-fe1b-435a-943e-425ef518ed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:22.146289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e65d-fe1b-435a-943e-425ef518ed4d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:22.146774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e65d-fe1b-435a-943e-425ef518ed4d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:22.147245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4e65d-fe1b-435a-943e-425ef518ed4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:22.160367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4e65d-fe1b-435a-943e-425ef518ed4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6fa4e65d-fe1b-435a-943e-425ef518ed4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:22.169853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:22.170910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 22:23:22.171747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:22.174450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 237/479] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:23:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:22.182063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff82ef6-4dcb-4862-ba42-c1f8dd4a6663 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:22.325801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff82ef6-4dcb-4862-ba42-c1f8dd4a6663 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:22.361716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36378a21-c45d-4626-8c46-8fb8afdac819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:22.362773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378a21-c45d-4626-8c46-8fb8afdac819 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:22.363245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378a21-c45d-4626-8c46-8fb8afdac819 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:22.363703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36378a21-c45d-4626-8c46-8fb8afdac819 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:22.364633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36378a21-c45d-4626-8c46-8fb8afdac819 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:22.365126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36378a21-c45d-4626-8c46-8fb8afdac819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:22.366714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36378a21-c45d-4626-8c46-8fb8afdac819 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:22.375642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 243/480] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:23.873847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec017-aa0f-4b49-ac36-4149ed97b82f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:23.874905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec017-aa0f-4b49-ac36-4149ed97b82f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:23.875387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ec017-aa0f-4b49-ac36-4149ed97b82f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:23.877245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 238/481] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:23.891517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4dfa-6ec0-4a9c-a1de-de514b313658 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:23.892408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4dfa-6ec0-4a9c-a1de-de514b313658 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:23.892879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4dfa-6ec0-4a9c-a1de-de514b313658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:23.915283 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-81ff4dfa-6ec0-4a9c-a1de-de514b313658 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:23.916890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-81ff4dfa-6ec0-4a9c-a1de-de514b313658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:23.973790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:24.004522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 244/482] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:24.048829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ec017-aa0f-4b49-ac36-4149ed97b82f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:24.143058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:24.195729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ec017-aa0f-4b49-ac36-4149ed97b82f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:24.217547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad5b07-841c-4c45-8444-38c92c0b9c1c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.217865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad5b07-841c-4c45-8444-38c92c0b9c1c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.218114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad5b07-841c-4c45-8444-38c92c0b9c1c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.223039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 245/483] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:24.227690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3c87-bafb-4849-a3ed-8daf12229b92 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.227982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3c87-bafb-4849-a3ed-8daf12229b92 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.228253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a3c87-bafb-4849-a3ed-8daf12229b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.240142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31a146-c9c1-46ce-a7af-07bfaea9d5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:24.240945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a146-c9c1-46ce-a7af-07bfaea9d5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.241225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a146-c9c1-46ce-a7af-07bfaea9d5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.241499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31a146-c9c1-46ce-a7af-07bfaea9d5f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.252515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31a146-c9c1-46ce-a7af-07bfaea9d5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-3f31a146-c9c1-46ce-a7af-07bfaea9d5f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:24.260925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:24.261869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:24.262697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 239/484] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:24.263708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d82a3c87-bafb-4849-a3ed-8daf12229b92 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:24.264307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d82a3c87-bafb-4849-a3ed-8daf12229b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:24.273235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31a146-c9c1-46ce-a7af-07bfaea9d5f4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:24.378928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 246/485] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:24.380263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d6ac-e88c-4372-974e-6ee4c3619920 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.380548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d6ac-e88c-4372-974e-6ee4c3619920 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.380825 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d6ac-e88c-4372-974e-6ee4c3619920 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.390574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 247/486] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:24.390828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31a146-c9c1-46ce-a7af-07bfaea9d5f4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:24.391896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eaf95-2507-4c03-aee7-a9bf54c95f22 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.392182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eaf95-2507-4c03-aee7-a9bf54c95f22 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.392463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eaf95-2507-4c03-aee7-a9bf54c95f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.418514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:24.422381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a17eaf95-2507-4c03-aee7-a9bf54c95f22 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:24.423577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a17eaf95-2507-4c03-aee7-a9bf54c95f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:24.427531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:24.428363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.428781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.429191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.430840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:24.430840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:24.432363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:24.447859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 240/487] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:24.448865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:24.514270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 248/488] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:24.515593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eaf95-2507-4c03-aee7-a9bf54c95f22 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:24.565124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:24.583145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179598c-49e1-4701-aa57-1a05f1896c52 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:24.624415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393185c-1c51-4c48-b3cc-8ac031207fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:24.625312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393185c-1c51-4c48-b3cc-8ac031207fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.625593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393185c-1c51-4c48-b3cc-8ac031207fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.625858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393185c-1c51-4c48-b3cc-8ac031207fd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.636550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eaf95-2507-4c03-aee7-a9bf54c95f22 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:24.639753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393185c-1c51-4c48-b3cc-8ac031207fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e393185c-1c51-4c48-b3cc-8ac031207fd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:24.648584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:24.650309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:24.651357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 241/489] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:24.652158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393185c-1c51-4c48-b3cc-8ac031207fd6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:24.676891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:24.677895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.678375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.678797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.690443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:24.692091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:24.711670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:24.712240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:24.713095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:24.714015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:24.714015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:24.714015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:24.714015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:24.715888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 249/490] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:24.716928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:24.784657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393185c-1c51-4c48-b3cc-8ac031207fd6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:24.827420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21c5ab-bcdf-4fc0-bce3-a82ca54d444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:24.828090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:24.829147 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21c5ab-bcdf-4fc0-bce3-a82ca54d444e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.829639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21c5ab-bcdf-4fc0-bce3-a82ca54d444e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.830122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21c5ab-bcdf-4fc0-bce3-a82ca54d444e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.839493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a21f1-b9ed-4eab-a55e-69a81b0582c0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:24.842308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21c5ab-bcdf-4fc0-bce3-a82ca54d444e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-df21c5ab-bcdf-4fc0-bce3-a82ca54d444e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:24.851215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:24.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 242/491] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:24.861659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21c5ab-bcdf-4fc0-bce3-a82ca54d444e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:24.881202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:24.882078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:24.882621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:24.882956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:24.884493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:24.884819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:24.886611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:24.898617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 250/492] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:24.900022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:24.976830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21c5ab-bcdf-4fc0-bce3-a82ca54d444e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:24.988430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.013337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e5653-213b-466b-a200-59303e573add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.013991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5653-213b-466b-a200-59303e573add None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.014294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5653-213b-466b-a200-59303e573add None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.014566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e5653-213b-466b-a200-59303e573add None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.015277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e5653-213b-466b-a200-59303e573add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:25.015583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e5653-213b-466b-a200-59303e573add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.016946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e5653-213b-466b-a200-59303e573add None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.020285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611bed-9061-4ecc-95cd-a16e853d3ddd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.034139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 243/493] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:25.034839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e5653-213b-466b-a200-59303e573add None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.064259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9945e-1bd2-4889-8772-4d77af411c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.064918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9945e-1bd2-4889-8772-4d77af411c8d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.065201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9945e-1bd2-4889-8772-4d77af411c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.065474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9945e-1bd2-4889-8772-4d77af411c8d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.066261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9945e-1bd2-4889-8772-4d77af411c8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:25.066565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9945e-1bd2-4889-8772-4d77af411c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.068193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9945e-1bd2-4889-8772-4d77af411c8d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.081432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 251/494] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:25.081432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176734a6-3fe5-440a-944b-50a7e09ec765 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.081432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176734a6-3fe5-440a-944b-50a7e09ec765 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.081432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176734a6-3fe5-440a-944b-50a7e09ec765 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.089519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 252/495] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:25.089519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176734a6-3fe5-440a-944b-50a7e09ec765 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.105394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.148660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e5653-213b-466b-a200-59303e573add None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.184555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.185339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.185614 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.185883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.190937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176734a6-3fe5-440a-944b-50a7e09ec765 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.197574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.199130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:25.218221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:25.219126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:25.220023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:25.220023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:25.220023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:25.220023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:25.220023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 244/496] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:25.220296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.233031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e9be5-7816-43e4-89a1-bddc53eeb5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.233758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9be5-7816-43e4-89a1-bddc53eeb5fe None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.234059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9be5-7816-43e4-89a1-bddc53eeb5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.234338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e9be5-7816-43e4-89a1-bddc53eeb5fe None admin] PATH_INFO: `/v3/users/glance` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.242203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e9be5-7816-43e4-89a1-bddc53eeb5fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.243791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e9be5-7816-43e4-89a1-bddc53eeb5fe None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.246564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-dd4e9be5-7816-43e4-89a1-bddc53eeb5fe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:25.263323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:25.264280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:25.265847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 253/497] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:25.267286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b995f5-3910-4ba2-b941-5a041769c78e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.267573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b995f5-3910-4ba2-b941-5a041769c78e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.267852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b995f5-3910-4ba2-b941-5a041769c78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.285340 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-99b995f5-3910-4ba2-b941-5a041769c78e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:25.286859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-99b995f5-3910-4ba2-b941-5a041769c78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:25.334817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbabfb8-4548-4699-b176-b9aec4e32e47 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.362141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 254/498] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:25.362141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b995f5-3910-4ba2-b941-5a041769c78e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.374620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.375410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.375684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.375963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.386040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.388464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.390327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:25.410545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:25.411455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:25.412311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:25.412311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:25.412311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:25.412311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:25.413118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 245/499] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:25.414039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.484287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b995f5-3910-4ba2-b941-5a041769c78e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.494907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.520093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29e267-7255-4002-845e-c31df07c642b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.520645 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.521300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.521580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.521854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.522601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:25.522907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.524374 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.535398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 255/500] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:25.536199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.555655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.556311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.556584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.556848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.558050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:25.558357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.559780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.595340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 246/501] 10.222.0.70 () {56 vars in 1137 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:25.596141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.601731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.636902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc85c2f-5219-41ac-9068-cdd605ec23f6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.670386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06061c-ea9b-43c2-aec6-4fb5ba2a9059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.671163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06061c-ea9b-43c2-aec6-4fb5ba2a9059 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.671434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06061c-ea9b-43c2-aec6-4fb5ba2a9059 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.671698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06061c-ea9b-43c2-aec6-4fb5ba2a9059 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.681580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06061c-ea9b-43c2-aec6-4fb5ba2a9059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1a06061c-ea9b-43c2-aec6-4fb5ba2a9059 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:25.689185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:25.690259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 256/502] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:25.696297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcaf20-2519-4ee3-abf5-19f0abc3d6f4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.697182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcaf20-2519-4ee3-abf5-19f0abc3d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.697182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcaf20-2519-4ee3-abf5-19f0abc3d6f4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.697182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 257/503] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:25.697182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcaf20-2519-4ee3-abf5-19f0abc3d6f4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.701701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3b948-8a90-47d6-b9d4-9c35bdd3ce87 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.731884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.736759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.737342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.737618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.737885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.738676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:25.747441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.747441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.751527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 247/504] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:25.752376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.801385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcaf20-2519-4ee3-abf5-19f0abc3d6f4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.825974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.834691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.835467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.835742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.836011 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.843846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.845270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.852605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674048-ca4f-431b-929e-a020b0ceb738 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:25.859901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:25.861005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 258/505] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:25.862165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:25.888906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c53788-4d6d-4555-ab5d-0cefbda13fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.889551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53788-4d6d-4555-ab5d-0cefbda13fdc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.889832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53788-4d6d-4555-ab5d-0cefbda13fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.890206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c53788-4d6d-4555-ab5d-0cefbda13fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.948388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:25.957572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c53788-4d6d-4555-ab5d-0cefbda13fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:25.959065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c53788-4d6d-4555-ab5d-0cefbda13fdc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:25.963449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0008b-3eee-4a16-b976-642f82b2f2ee None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:25.997361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9e5ce-1a17-40ad-9f71-5e52c756831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:25.997957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9e5ce-1a17-40ad-9f71-5e52c756831a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:25.998266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9e5ce-1a17-40ad-9f71-5e52c756831a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:25.998541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9e5ce-1a17-40ad-9f71-5e52c756831a None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:25.999629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9e5ce-1a17-40ad-9f71-5e52c756831a None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:25.999931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9e5ce-1a17-40ad-9f71-5e52c756831a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.001587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9e5ce-1a17-40ad-9f71-5e52c756831a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.009890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 259/506] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:26.011112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb56b5-0f41-4cbf-b2f6-8817e1d1e700 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.011394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb56b5-0f41-4cbf-b2f6-8817e1d1e700 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.011670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb56b5-0f41-4cbf-b2f6-8817e1d1e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.027292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1deb56b5-0f41-4cbf-b2f6-8817e1d1e700 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:26.028473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1deb56b5-0f41-4cbf-b2f6-8817e1d1e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:26.059852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 248/507] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:26.060699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c53788-4d6d-4555-ab5d-0cefbda13fdc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.080360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:26.103537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 260/508] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:26.104637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb56b5-0f41-4cbf-b2f6-8817e1d1e700 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.186498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:26.196367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c53788-4d6d-4555-ab5d-0cefbda13fdc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.229093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.229905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.230412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.230852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.237983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.239579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:26.255207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:26.256129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:26.257042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 249/509] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:26.257599 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.268125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb56b5-0f41-4cbf-b2f6-8817e1d1e700 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.306120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.307266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.307774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.308280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.309641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:26.309956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.311759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.348735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 261/510] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:26.349556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.361901 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d16aa6-23fd-465d-9a71-51004bf49faa None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.382710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:26.395864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.396642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.396915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.397179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.407777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.409219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:26.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:26.427403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:26.428392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:26.428392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:26.428392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:26.428392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:26.428392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 250/511] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:26.428392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.435746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:26.448359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9371e3-4a8a-45ed-a73b-9a86569a8d8e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.482878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.483655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.483929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.484198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.494535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.495990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:26.514145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:26.515105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:26.515981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:26.515981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:26.515981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:26.515981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:26.515981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 262/512] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:26.515981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.534065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63d32f-654b-4a25-9fc8-00eb875c9a21 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.568055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.568842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.569122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.569385 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.579739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.581162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:26.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:26.600066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:26.600947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:26.600947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:26.600947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:26.600947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:26.600947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 251/513] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:26.601226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.603475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:26.614883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd61b1-ce20-4cbf-a363-40fe66c3f483 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.648478 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.650046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.650339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.650617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.651453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:26.651762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.653173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.660760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:26.670587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 263/514] 10.222.0.70 () {56 vars in 1137 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:26.671380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.711325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c94e-5e8d-416a-94f3-ceda24730a41 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.744066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebe355-7011-44c8-ac1e-2fedfeb8d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.744697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe355-7011-44c8-ac1e-2fedfeb8d78c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.744974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe355-7011-44c8-ac1e-2fedfeb8d78c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.745245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe355-7011-44c8-ac1e-2fedfeb8d78c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.768069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e01fb-fe79-488a-b344-633f2f5c450d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.801656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.802333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.802616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.802893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.803607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:26.803912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.805491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.811828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebe355-7011-44c8-ac1e-2fedfeb8d78c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.813271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebe355-7011-44c8-ac1e-2fedfeb8d78c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.816355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 264/515] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:26.817142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.826900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:26.868414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:26.918523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 252/516] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:26.918523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebe355-7011-44c8-ac1e-2fedfeb8d78c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:26.921718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7aba9-39b6-4de4-acf7-5ba83d3906b2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:26.955573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:26.956221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:26.956503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:26.956779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:26.957494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:26.957799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:26.959289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:26.971346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 265/517] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:26.972133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.016230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebe355-7011-44c8-ac1e-2fedfeb8d78c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.036788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.050182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.050917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.051194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.051463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.052230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:27.052537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.053889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.068315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 253/518] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:27.069195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.075541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ab791-140c-444a-ae6c-bd44c69564bd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.087627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.110881 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394a331-85d9-4bac-9d12-fca92703f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.111514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a331-85d9-4bac-9d12-fca92703f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.111789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a331-85d9-4bac-9d12-fca92703f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.112060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a331-85d9-4bac-9d12-fca92703f8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.167624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb64b29-2496-4f28-96e5-c5a78d667008 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.180352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394a331-85d9-4bac-9d12-fca92703f8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.181835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394a331-85d9-4bac-9d12-fca92703f8c7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.201822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.202662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.202945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.203218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.210621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.212166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:27.226301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:27.227427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:27.228341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 254/519] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:27.228924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.250262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.285332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 266/520] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:27.286590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394a331-85d9-4bac-9d12-fca92703f8c7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.309398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.332201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef349-7585-4628-916a-564fec6924b2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.365914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.366733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.367016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.367346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.378506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.380024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.388595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394a331-85d9-4bac-9d12-fca92703f8c7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:27.396757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:27.397724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:27.398673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:27.398673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:27.398673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:27.398673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:27.398673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 255/521] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:27.398939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.425008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.425781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.426095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.426370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.433493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.435658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:27.449949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:27.450837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:27.451775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 267/522] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:27.452298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.479502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.499642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0104192-fca3-4ecd-9b22-4a0bbb87fc24 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.524367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.531957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6a89-8981-4684-bd12-2e4d4abb64a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.532611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6a89-8981-4684-bd12-2e4d4abb64a1 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.532886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6a89-8981-4684-bd12-2e4d4abb64a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.536902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6a89-8981-4684-bd12-2e4d4abb64a1 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.536902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e6a89-8981-4684-bd12-2e4d4abb64a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.536902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e6a89-8981-4684-bd12-2e4d4abb64a1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.549837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa782a-4116-4b53-8ef6-fb9ea2ecabac None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.583069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.583698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.583978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.584251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.585071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:27.585375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.586917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.603732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 268/523] 10.222.0.70 () {56 vars in 1139 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:27.604503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.619519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 256/524] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:23:27 2022] POST /identity/v3/users => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:27.620343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6a89-8981-4684-bd12-2e4d4abb64a1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.692722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.710544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5507a2-add1-4651-b93a-585d3e6d6252 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.748926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.749541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6a89-8981-4684-bd12-2e4d4abb64a1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.749729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.750033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.750309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.762078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.763552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:27.782909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:27.783979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:27.784826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:27.784826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:27.784826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:27.784826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:27.784826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 269/525] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:27.785608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.793169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.793854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.794167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.794445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.795180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:27.795488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.796888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.809757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 257/526] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:27.810559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:27.868018 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.905107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e4bad-22ec-4696-948a-d58a8e75987d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.927217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4c57b-4f0e-4b49-b11f-278c5ef64964 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:27.942091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.943445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.943919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.944206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.945000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:27.945314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:27.947411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:27.952927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:27.967281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a94a-4b4d-41f8-a7f3-2818c9123697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:27.968017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a94a-4b4d-41f8-a7f3-2818c9123697 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:27.968295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a94a-4b4d-41f8-a7f3-2818c9123697 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:27.968571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3a94a-4b4d-41f8-a7f3-2818c9123697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:27.974073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 270/527] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:27.974073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.049050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a94a-4b4d-41f8-a7f3-2818c9123697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.050633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3a94a-4b4d-41f8-a7f3-2818c9123697 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.087998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa647509-ddb9-4a00-a8a9-7f5de02a6e75 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.104809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:28.124989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.125660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.125942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.126252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.127046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:28.127355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.128722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.145750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 271/528] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:28.145750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.169144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 258/529] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:28.169833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a94a-4b4d-41f8-a7f3-2818c9123697 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.215247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:28.260251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a39f-2fb8-43e8-a8f5-b82fe7c5246c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.275613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3a94a-4b4d-41f8-a7f3-2818c9123697 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.298479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.299267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.299547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.299988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.307068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.308505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.310572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.311215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.311495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.311769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.312600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=cc7d46c2766b4481963adefebea94c09) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:28.312912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.314370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.327081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 259/530] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/role_assignments?user.id=cc7d46c2766b4481963adefebea94c09&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:28.327081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:28.327350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:28.328231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 272/531] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:28.329082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.345810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:28.458052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93602-6479-4d0b-8587-9d58e2743926 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.485490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ae264-f497-4b69-89ec-677143ad6b0d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.500236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.501297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.501647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.501991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.510168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:28.511391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.513137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.529586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.530402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.530672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.530944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:28.531373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:28.532157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:28.533082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 260/532] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:28.534034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.555205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.556723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:28.588045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:28.588946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:28.589781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:28.589781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:28.589781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:28.589781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:28.597542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 273/533] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:28.597542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.622799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:28.668928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12076a2c-0cec-4a62-a95a-e2280cbec6dd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.703569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842306d2-c304-4579-b4b1-2cf4da0c8324 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.715037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.715752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.716361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.716361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.717272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:28.717646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.719279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.742166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 261/534] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:28.743871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.745810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.746683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.747136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.747574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.748858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:28.750205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.751701 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.769555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 274/535] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:28.770469 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.802669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:28.869384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de0cdb-4389-4b6f-a4e3-4b321a7dec9c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.897341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:28.901538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423fdae-ffd1-4dbf-aa7f-09143d054626 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:28.909060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.911003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.911003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.911003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.911674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:28.911981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.914095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.934188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 262/536] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:28.935068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:28.944155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:28.944804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:28.945084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:28.945356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:28.946412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=55b3fcbfb08544d482bd0bea4b3d3f0f) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:28.946726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:28.948167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:28.954575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 275/537] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/role_assignments?user.id=55b3fcbfb08544d482bd0bea4b3d3f0f&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:28.955389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:29.062820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d157a-f9b1-4a0b-953c-8d0c28979438 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:29.081000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:29.093728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7b93d-bc04-48ab-b322-ebd3fe4261d7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:29.136435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:29.137656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:29.138214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:29.138628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:29.147561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:29.150079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:29.158876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:29.159690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:29.160044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:29.160387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:29.161302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=fe4941cd1afb4318b42263390025d198) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:29.161697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:29.163246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:29.168649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:29.169528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:29.170411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:29.170411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:29.170411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:29.170411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:29.170411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:29.170411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:29.170411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:29.170411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:29.173263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 276/538] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:29.180054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:29.180805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 263/539] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:28 2022] GET /identity/v3/role_assignments?user.id=fe4941cd1afb4318b42263390025d198&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:29.304284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b5179-7896-4aa2-8165-14e0bac9fa09 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:29.370624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68393c0c-e36a-454c-9989-e85109d3fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:29.371570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393c0c-e36a-454c-9989-e85109d3fa67 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:29.372027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393c0c-e36a-454c-9989-e85109d3fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:29.372493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393c0c-e36a-454c-9989-e85109d3fa67 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:29.373455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68393c0c-e36a-454c-9989-e85109d3fa67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:29.373934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68393c0c-e36a-454c-9989-e85109d3fa67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:29.375955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68393c0c-e36a-454c-9989-e85109d3fa67 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:29.394055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 277/540] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:29.400908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:29.493578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:29.564052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65f190-9e12-4e1f-93d3-e9f8ac84289e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:29.608182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7617b2-f7f9-4c76-8c22-eb174f338f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:29.608848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7617b2-f7f9-4c76-8c22-eb174f338f58 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:29.609127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7617b2-f7f9-4c76-8c22-eb174f338f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:29.609401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7617b2-f7f9-4c76-8c22-eb174f338f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:29.610349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7617b2-f7f9-4c76-8c22-eb174f338f58 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=47783bb7d4cc41c6ac4c1adb682b093b) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:29.610349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7617b2-f7f9-4c76-8c22-eb174f338f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:29.612519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7617b2-f7f9-4c76-8c22-eb174f338f58 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:29.621957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 264/541] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:29 2022] GET /identity/v3/role_assignments?user.id=47783bb7d4cc41c6ac4c1adb682b093b&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:30.244075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c40ca2-6592-495c-b106-cfd996e13007 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:30.244591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c40ca2-6592-495c-b106-cfd996e13007 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:30.244591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c40ca2-6592-495c-b106-cfd996e13007 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:30.246241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 278/542] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:30.251455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7984f0-2e45-4a7b-a445-71365bcc66cc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:30.251885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7984f0-2e45-4a7b-a445-71365bcc66cc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:30.252030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7984f0-2e45-4a7b-a445-71365bcc66cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:30.269589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ca7984f0-2e45-4a7b-a445-71365bcc66cc None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:30.270789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ca7984f0-2e45-4a7b-a445-71365bcc66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:30.341932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 265/543] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:30.365824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c40ca2-6592-495c-b106-cfd996e13007 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:30.382774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:30.476510 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c40ca2-6592-495c-b106-cfd996e13007 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:30.512362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dcc2b-049b-467a-b541-194c6546edc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:30.513154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dcc2b-049b-467a-b541-194c6546edc9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:30.513430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dcc2b-049b-467a-b541-194c6546edc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:30.513698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dcc2b-049b-467a-b541-194c6546edc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:30.524724 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dcc2b-049b-467a-b541-194c6546edc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1e8dcc2b-049b-467a-b541-194c6546edc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:30.532511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:30.534601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:30.536587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 279/544] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:30.542026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7984f0-2e45-4a7b-a445-71365bcc66cc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:30.590400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:30.645629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7984f0-2e45-4a7b-a445-71365bcc66cc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:30.681336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:30.681996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:30.682297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:30.682569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:30.683307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:30.683607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:30.684971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:30.693507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 266/545] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:30.699058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dcc2b-049b-467a-b541-194c6546edc9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:30.797036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:30.833783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dcc2b-049b-467a-b541-194c6546edc9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:30.875622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca100943-a082-44be-ae84-69c984287a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:30.876411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100943-a082-44be-ae84-69c984287a05 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:30.876683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100943-a082-44be-ae84-69c984287a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:30.876948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100943-a082-44be-ae84-69c984287a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:30.898230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca100943-a082-44be-ae84-69c984287a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:30.900136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca100943-a082-44be-ae84-69c984287a05 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ca100943-a082-44be-ae84-69c984287a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:30.924532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:30.926607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:30.928666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:30.928666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:30.928666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:30.928666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:30.928666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 280/546] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:30.933021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:30.964390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353386-de8e-40ac-bdec-44d2becef0d2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:30.964729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353386-de8e-40ac-bdec-44d2becef0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:30.964937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e353386-de8e-40ac-bdec-44d2becef0d2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:30.966596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 281/547] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:30.975081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed720-e25b-4a7e-8c3e-68e71953a6d6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:30.975393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed720-e25b-4a7e-8c3e-68e71953a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:30.975913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ed720-e25b-4a7e-8c3e-68e71953a6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.006994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ad8ed720-e25b-4a7e-8c3e-68e71953a6d6 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:31.008793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ad8ed720-e25b-4a7e-8c3e-68e71953a6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:31.048510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded20830-e124-4f88-a21c-defa316ea313 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:31.059251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:31.086180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:31.094229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:31.094229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:31.094229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.094229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:31.094229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:31.094229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:31.103122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 267/548] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:31.108510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:31.176783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 282/549] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:31.216515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8115-4c38-4302-8bb7-7e604314cc7e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:31.219060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ed720-e25b-4a7e-8c3e-68e71953a6d6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:31.254834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:31.255616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:31.255891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:31.256155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.264571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:31.266223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:31.282024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:31.282967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:31.283881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 268/550] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:31.289062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:31.317060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:31.334441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:31.395203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30b46f-2b16-4ce1-b57e-3051a0d46758 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:31.435786 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:31.435971 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ed720-e25b-4a7e-8c3e-68e71953a6d6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:31.436428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:31.436716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:31.436992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.437950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:31.438394 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:31.439843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:31.459571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 269/551] 10.222.0.70 () {56 vars in 1135 bytes} [Wed May 18 22:23:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:31.465823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:31.492086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80ea77-cf65-45ff-a2a3-1daced205ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:31.493428 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ea77-cf65-45ff-a2a3-1daced205ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:31.493712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ea77-cf65-45ff-a2a3-1daced205ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:31.493986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80ea77-cf65-45ff-a2a3-1daced205ae7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.504523 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80ea77-cf65-45ff-a2a3-1daced205ae7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-af80ea77-cf65-45ff-a2a3-1daced205ae7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:31.513076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:31.514070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:31.514933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 283/552] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:31.520905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80ea77-cf65-45ff-a2a3-1daced205ae7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:31.630361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:31.672165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c981f-3949-4486-9c83-6fe4ca50a71f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:31.675364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80ea77-cf65-45ff-a2a3-1daced205ae7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:31.693017 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:31.723129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:31.723804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:31.724081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:31.724458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.725210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:31.725509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:31.727453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:31.744359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 284/553] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:31.750022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:31.755598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2a3ee-90e4-419e-97a1-e585125a0f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:31.756248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a3ee-90e4-419e-97a1-e585125a0f2d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:31.756523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a3ee-90e4-419e-97a1-e585125a0f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:31.756785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2a3ee-90e4-419e-97a1-e585125a0f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.857126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727feec-dcac-47aa-8597-29a36796df87 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:31.877202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2a3ee-90e4-419e-97a1-e585125a0f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:31.878841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2a3ee-90e4-419e-97a1-e585125a0f2d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:31.893092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27234664-785b-4920-bdd0-6a1dc211c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:31.893928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27234664-785b-4920-bdd0-6a1dc211c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:31.894279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27234664-785b-4920-bdd0-6a1dc211c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:31.894552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27234664-785b-4920-bdd0-6a1dc211c1f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.905735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27234664-785b-4920-bdd0-6a1dc211c1f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:31.907203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27234664-785b-4920-bdd0-6a1dc211c1f8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-27234664-785b-4920-bdd0-6a1dc211c1f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:31.928045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:31.928979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:31.930487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:31.930487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:31.930487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:31.930487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:31.931693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 285/554] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:31.935278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b459a-967c-42ad-bf6b-6db0d09a8f14 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:31.935810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b459a-967c-42ad-bf6b-6db0d09a8f14 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:31.936454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b459a-967c-42ad-bf6b-6db0d09a8f14 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:31.941953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 286/555] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:31.943230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b459a-967c-42ad-bf6b-6db0d09a8f14 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:31.980354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:31.989352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:32.006987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 270/556] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:32.009328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766907-b4b8-460e-9ed1-2c1122922314 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.009609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766907-b4b8-460e-9ed1-2c1122922314 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.009978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766907-b4b8-460e-9ed1-2c1122922314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.027594 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f3766907-b4b8-460e-9ed1-2c1122922314 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:32.028820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f3766907-b4b8-460e-9ed1-2c1122922314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:32.083957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b459a-967c-42ad-bf6b-6db0d09a8f14 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.129198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 271/557] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:32.130603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766907-b4b8-460e-9ed1-2c1122922314 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.132350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.133554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.133828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.134122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.135138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:32.135448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:32.137410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:32.154078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 287/558] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:32.155641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.285271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766907-b4b8-460e-9ed1-2c1122922314 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.289661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:32.302606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:32.305635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d908bf-5e4c-4c73-8c96-aca35b314f04 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.321216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.322020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.322306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.322569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.332841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:32.336863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:32.353771 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84e4b3-6806-447e-9866-cf62472031aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:32.354597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:32.356340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:32.357351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:32.357351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:32.357351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:32.357351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:32.357802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e4b3-6806-447e-9866-cf62472031aa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.357802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e4b3-6806-447e-9866-cf62472031aa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.357802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84e4b3-6806-447e-9866-cf62472031aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.360094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 272/559] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:32.360943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.370715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84e4b3-6806-447e-9866-cf62472031aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ac84e4b3-6806-447e-9866-cf62472031aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:32.379267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:32.380218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:32.381147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:32.385410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 288/560] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:32.386770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89acfe-4609-46ea-b334-f34644140425 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.387054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89acfe-4609-46ea-b334-f34644140425 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.387330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89acfe-4609-46ea-b334-f34644140425 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.388872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 289/561] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:32.389573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89acfe-4609-46ea-b334-f34644140425 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.479252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964d74-cfff-44d9-acd6-6dac2ace8950 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.503892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89acfe-4609-46ea-b334-f34644140425 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.519101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.519893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.520171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.520450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.528559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:32.530206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:32.545469 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da4e73-f6c8-475d-a7f5-8ffe58a315c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:32.545623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:32.551438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 22:23:32.552582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:32.553146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4e73-f6c8-475d-a7f5-8ffe58a315c4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.553146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4e73-f6c8-475d-a7f5-8ffe58a315c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.553146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4e73-f6c8-475d-a7f5-8ffe58a315c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.553338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 273/562] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:32.553420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da4e73-f6c8-475d-a7f5-8ffe58a315c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:32.553420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da4e73-f6c8-475d-a7f5-8ffe58a315c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:32.553554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.553624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da4e73-f6c8-475d-a7f5-8ffe58a315c4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:32.566464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 290/563] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:32.567615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89895-db36-457f-bf64-17db8ac9648b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.568247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89895-db36-457f-bf64-17db8ac9648b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.568591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89895-db36-457f-bf64-17db8ac9648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.585533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-52e89895-db36-457f-bf64-17db8ac9648b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:32.586791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-52e89895-db36-457f-bf64-17db8ac9648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:32.588325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:32.588880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:32.655260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 291/564] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:32.656095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e89895-db36-457f-bf64-17db8ac9648b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.660546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbec30-285a-45f4-b979-6948a6ccd549 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.698039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.698696 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.698969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.699236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.700038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:32.700505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:32.701946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:32.709589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 274/565] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:32.710376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.757452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e89895-db36-457f-bf64-17db8ac9648b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.790687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11eb591-4833-4c85-846b-3ed105c6a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.791344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb591-4833-4c85-846b-3ed105c6a293 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.791619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb591-4833-4c85-846b-3ed105c6a293 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.791887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11eb591-4833-4c85-846b-3ed105c6a293 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.792702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb591-4833-4c85-846b-3ed105c6a293 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:32.793004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb591-4833-4c85-846b-3ed105c6a293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:32.794467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11eb591-4833-4c85-846b-3ed105c6a293 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:32.799589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:32.802097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:32.809294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c5422-701d-44a4-8e8b-23da04f3b08e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.812353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 292/566] 10.222.0.70 () {56 vars in 1137 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:32.813660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d673-f8fb-448c-8e3d-585c40600018 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.813942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d673-f8fb-448c-8e3d-585c40600018 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.814239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384d673-f8fb-448c-8e3d-585c40600018 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.815627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 293/567] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:32.818820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384d673-f8fb-448c-8e3d-585c40600018 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.843688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.844466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.844740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.845007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.852136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:32.853775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:32.867919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:32.868875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:32.869771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 275/568] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:32.870505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:32.920976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384d673-f8fb-448c-8e3d-585c40600018 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.954516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b37d6b-8d94-4425-8945-f2be3378525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:32.955291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b37d6b-8d94-4425-8945-f2be3378525a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:32.955566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b37d6b-8d94-4425-8945-f2be3378525a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:32.955834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b37d6b-8d94-4425-8945-f2be3378525a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:32.966216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b37d6b-8d94-4425-8945-f2be3378525a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:32.969416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65bcf2-379c-4291-908b-2ff9fc1cf847 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-09b37d6b-8d94-4425-8945-f2be3378525a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:32.973763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:32.974766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:32.975636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 294/569] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:32.976370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b37d6b-8d94-4425-8945-f2be3378525a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.006780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8197e-ab87-4d7a-b0f4-3303e7b85ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.007560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8197e-ab87-4d7a-b0f4-3303e7b85ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.007871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8197e-ab87-4d7a-b0f4-3303e7b85ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.008720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8197e-ab87-4d7a-b0f4-3303e7b85ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.019184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8197e-ab87-4d7a-b0f4-3303e7b85ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.020639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8197e-ab87-4d7a-b0f4-3303e7b85ad0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.032008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-02a8197e-ab87-4d7a-b0f4-3303e7b85ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:33.037400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:33.038330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:33.039289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:33.039289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:33.039289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:33.039289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:33.039289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 276/570] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:33.039965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c98d-e615-4d36-bdca-ec8f29620ecd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.040423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c98d-e615-4d36-bdca-ec8f29620ecd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.040423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1c98d-e615-4d36-bdca-ec8f29620ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.045514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:33.057809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a3c1c98d-e615-4d36-bdca-ec8f29620ecd None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:33.059020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a3c1c98d-e615-4d36-bdca-ec8f29620ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:33.085187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b37d6b-8d94-4425-8945-f2be3378525a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.119579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.120400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.120680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.120947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.126226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 277/571] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:33.127057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1c98d-e615-4d36-bdca-ec8f29620ecd None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.131322 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.132751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:33.150266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:33.151361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:33.152779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:33.152779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:33.152779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:33.152779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:33.152779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 295/572] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:33.152779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.237175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1c98d-e615-4d36-bdca-ec8f29620ecd None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.253393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb676-3f08-4c53-b02a-bf6a0e4659a9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.262893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:33.267070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:33.271886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.272728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.273055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.273337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.274432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:33.274744 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.276185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.287246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.287407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 278/573] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:33.287898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.288149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.288246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.288509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.289276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:33.289677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.291073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.299954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 296/574] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:33.300676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.389768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6874ea-b1ee-4c1b-88b1-dedbf17c106a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.399173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d8962-8ab5-4e42-a2e8-1e689b75ff8e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.422835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.423483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.423774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.424034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.424737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:33.425036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.426476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.433141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748060b6-aad5-420b-a4b1-1ec6934e2a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.433933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748060b6-aad5-420b-a4b1-1ec6934e2a97 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.434246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748060b6-aad5-420b-a4b1-1ec6934e2a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.434526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748060b6-aad5-420b-a4b1-1ec6934e2a97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.438397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 279/575] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:33.439173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.445044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748060b6-aad5-420b-a4b1-1ec6934e2a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-748060b6-aad5-420b-a4b1-1ec6934e2a97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:33.452973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:33.454093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 297/576] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:33.454997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748060b6-aad5-420b-a4b1-1ec6934e2a97 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.485316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:33.497150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:33.542687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be07ee-df41-4d8d-ba08-0045514e2a76 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.558980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748060b6-aad5-420b-a4b1-1ec6934e2a97 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.577837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.578516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.578790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.579055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.579756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:33.580055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.581400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.591970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.592610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.592895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.593174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.593435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 280/577] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:33.594023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=c90d79a9665b4d9f8dc1ea440882a65c) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:33.594235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.594328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.595735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.602683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 298/578] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/role_assignments?user.id=c90d79a9665b4d9f8dc1ea440882a65c&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:33.603529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.715283 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:33.718928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc34ac-b504-41fa-a209-db82d0052cc1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.721677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d181bf-338a-485a-9504-e52429b6f240 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.733777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:33.757322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.758625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.759090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.759314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.759750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.759875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.760153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.760441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.769706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.771232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.774285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.776807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:33.786870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:33.787941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:33.788958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 299/579] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:33.790185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:33.800516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:33.801618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:33.802774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:33.802774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:33.802774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:33.802774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:33.805128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 281/580] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:33.806552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.904964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01cd01-ea0a-49cb-a32d-3c40d945e52c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.914206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab770a3e-0a01-41b6-97f2-bebcc5733369 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:33.941792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.942489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.943030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.943310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.944055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:33.944355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.945804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.950202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:33.950988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:33.951264 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:33.951645 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:33.959060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:33.959429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 300/581] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:33.960305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:33.960708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:33.975922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:33.977498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:33.978660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 282/582] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:33.979155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:33.986259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:34.007609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:34.082600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eefc44-1552-4dc9-83b8-c2b0b6989229 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.092078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bb8b7-6785-46d3-8c36-88de2f361060 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.119000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.119670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.119953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.120227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.121249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:34.121693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.123144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.129024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.129678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.129959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.130259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.130975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:34.131277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.132646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.142552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 301/583] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:34.143396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.149716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 283/584] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:34.150905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.224984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:34.240897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:34.251657 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce007d54-55a1-4850-9ec2-233d28856629 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.263712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894179-2070-4e4a-bd10-1310b7bf58a6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.289502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.290555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.290980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.291404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.301849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.301983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.302635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.302914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.303184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.303345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.303965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:34.304272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.306071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.324149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 284/585] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:34.324149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:34.324377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:34.325223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:34.326192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:34.326192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:34.326192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:34.326192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:34.326192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 302/586] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:34.326192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.425832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da6dfe-96f0-485c-8809-385a9aa7cb34 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.445515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70007-3256-4791-be47-a92308c9ad98 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.452394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:34.462258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.463819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.463819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.463819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.470737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.472175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.482427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.483250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.483526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.483795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:34.487704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:34.488643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:34.489632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 303/587] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:34.490261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.499635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.500997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.503553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:34.519475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:34.520570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:34.521694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:34.521694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:34.521694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:34.521694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:34.524076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 285/588] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:34.525065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.603710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b76a0-2d2f-4bb2-b663-ce948f5851fe None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.632230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a5e9f-c462-49a2-ae22-b20f6d8bdb7b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.639859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0bbc0-8401-41d4-86d5-aad01b4e73aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.640735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0bbc0-8401-41d4-86d5-aad01b4e73aa None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.641021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0bbc0-8401-41d4-86d5-aad01b4e73aa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.641299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0bbc0-8401-41d4-86d5-aad01b4e73aa None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/cc7d46c2766b4481963adefebea94c09/roles/5959b7a9b03c486fb50a3eafef4d3baf` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.657030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0bbc0-8401-41d4-86d5-aad01b4e73aa None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=cc7d46c2766b4481963adefebea94c09, role_id=5959b7a9b03c486fb50a3eafef4d3baf)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.658519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0bbc0-8401-41d4-86d5-aad01b4e73aa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.666809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.667462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.667735 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.668002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.668712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:34.669050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.670447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.681544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 286/589] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:34.682345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.722787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 304/590] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:23:34 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/cc7d46c2766b4481963adefebea94c09/roles/5959b7a9b03c486fb50a3eafef4d3baf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:34.724298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0bbc0-8401-41d4-86d5-aad01b4e73aa None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.743917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:34.802536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:34.812418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b672dc7-54d6-4a59-ba25-930d34905461 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.859022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0bbc0-8401-41d4-86d5-aad01b4e73aa None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:34.862579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.862957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.863231 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.863500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.864348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:34.864654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.866187 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.894721 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 287/591] 10.222.0.70 () {56 vars in 1137 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:34.895768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:34.903232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:34.904265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:34.904921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:34.905428 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:34.906422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:34.906940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:34.908547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:34.922615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 305/592] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:34.923800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.009157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6c9b8-8409-4246-a5bd-95304ef359bf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.034441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:35.046117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:35.050272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.051201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.051474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.051742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.052978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5142-b7f6-4adc-b68f-f02f05d64b9e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.059856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.061302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:35.085811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:35.087892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:35.089082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 288/593] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:35.092480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.106892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.108483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.109068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.109583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.123707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.125515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:35.143738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:35.144737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:35.145721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:35.145721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:35.145721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:35.145721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:35.152165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 306/594] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:35.153236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.225297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616b304-23be-415c-88c3-2e6ad192f3d1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.262766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.263823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.264099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.264364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.274611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.276060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.276939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cf23e-990b-4c4c-92f5-a4dbff15d583 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:35.294358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:35.295373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:35.296331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:35.296331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:35.296331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:35.296331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:35.296331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:35.296331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:35.296331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:35.296331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:35.298079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 289/595] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:35.299121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.324724 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.325590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.325901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.326680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.327810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:35.328123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.330270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.348196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:35.357062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 307/596] 10.222.0.70 () {56 vars in 1139 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:35.358281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.369681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:35.431209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2297d0a-320c-4ff2-a96e-9f47a678113f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.474124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.475252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.475788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.476269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.477872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:35.478589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.480219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.484328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351417fd-1583-46ae-9c0a-7c58ddcdee2c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.494492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 290/597] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:35.495662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.524516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.525207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.525432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.525703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.526584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:35.526809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.528231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.545411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 308/598] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:35.546347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.606121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:35.614177 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751f09-44ff-426f-b0ca-85e43533de2d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.619862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:35.652593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.653805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.654188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe657e-7653-4ac9-8f25-5cb2da0be8fa None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.660415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.660415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.667114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.668951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:35.689689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:35.690678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:35.691589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:35.691589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:35.691589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:35.691589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:35.693168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.694080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 291/599] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:35.694245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.694635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.695072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.695521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.703641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.705680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:35.722798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:35.723905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:35.724827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 309/600] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:35.727643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.811299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12ccc2-5c15-48fa-906d-8538150386c7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.839840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e7843-5deb-4cd2-9162-088b3e381aaf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:35.851123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e33e9-b3ae-41d6-ba49-54367bbcd5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.852336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e33e9-b3ae-41d6-ba49-54367bbcd5d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.852785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e33e9-b3ae-41d6-ba49-54367bbcd5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.853254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e33e9-b3ae-41d6-ba49-54367bbcd5d4 None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/55b3fcbfb08544d482bd0bea4b3d3f0f/roles/5959b7a9b03c486fb50a3eafef4d3baf` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.871675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:35.875618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e33e9-b3ae-41d6-ba49-54367bbcd5d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=55b3fcbfb08544d482bd0bea4b3d3f0f, role_id=5959b7a9b03c486fb50a3eafef4d3baf)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.877770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e33e9-b3ae-41d6-ba49-54367bbcd5d4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.881282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:35.887127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:35.887127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.887127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.887127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.887532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:35.887532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:35.887532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:35.898480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 310/601] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:35.899931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:35.980012 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 292/602] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:23:35 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/55b3fcbfb08544d482bd0bea4b3d3f0f/roles/5959b7a9b03c486fb50a3eafef4d3baf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:35.986498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512571f-86e3-4cb3-94dd-8c06e472d90a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:35.986498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512571f-86e3-4cb3-94dd-8c06e472d90a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:35.986498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512571f-86e3-4cb3-94dd-8c06e472d90a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:35.986498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 293/603] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:35.986498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512571f-86e3-4cb3-94dd-8c06e472d90a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:36.013289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aa185-3466-4f64-95da-b32a06a32fad None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:36.057700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a809a-ef73-4662-bb8b-3a2d95d9ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:36.061184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a809a-ef73-4662-bb8b-3a2d95d9ade9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:36.061184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a809a-ef73-4662-bb8b-3a2d95d9ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:36.061184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a809a-ef73-4662-bb8b-3a2d95d9ade9 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:36.061184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a809a-ef73-4662-bb8b-3a2d95d9ade9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:36.061184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a809a-ef73-4662-bb8b-3a2d95d9ade9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:36.063175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a809a-ef73-4662-bb8b-3a2d95d9ade9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:36.082840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 311/604] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:36.084308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4333-0363-4b9c-bcfb-2cf288c65db8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:36.084694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4333-0363-4b9c-bcfb-2cf288c65db8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:36.085070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f4333-0363-4b9c-bcfb-2cf288c65db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:36.108004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2b8f4333-0363-4b9c-bcfb-2cf288c65db8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:36.109567 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2b8f4333-0363-4b9c-bcfb-2cf288c65db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:36.133836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512571f-86e3-4cb3-94dd-8c06e472d90a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:36.172375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:36.183067 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:36.184273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:36.184756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:36.185196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:36.193355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:36.195206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:36.202534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 312/605] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:36.203264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f4333-0363-4b9c-bcfb-2cf288c65db8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:36.214141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:36.215113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:36.216348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 294/606] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:36.222696 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:36.287439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:36.325119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f4333-0363-4b9c-bcfb-2cf288c65db8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:36.348329 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36608770-cfd5-4451-be06-4f00acd3fcc9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:36.364702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2ff42-1c87-41a0-9159-ff26c6ad2a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:36.365617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ff42-1c87-41a0-9159-ff26c6ad2a47 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:36.365897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ff42-1c87-41a0-9159-ff26c6ad2a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:36.366229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ff42-1c87-41a0-9159-ff26c6ad2a47 None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/fe4941cd1afb4318b42263390025d198/roles/5959b7a9b03c486fb50a3eafef4d3baf` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:36.383525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2ff42-1c87-41a0-9159-ff26c6ad2a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=fe4941cd1afb4318b42263390025d198, role_id=5959b7a9b03c486fb50a3eafef4d3baf)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:36.385153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2ff42-1c87-41a0-9159-ff26c6ad2a47 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:36.391053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:36.392325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:36.392954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:36.393558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:36.395301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:36.398530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:36.398870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:36.415495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 295/607] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:36.416513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:36.482087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 313/608] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:23:36 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/fe4941cd1afb4318b42263390025d198/roles/5959b7a9b03c486fb50a3eafef4d3baf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:36.483226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2ff42-1c87-41a0-9159-ff26c6ad2a47 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:36.549117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:36.579469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32d8c-057a-4a3a-a512-c6455501ebfe None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:36.601216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:36.624212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b169d9e-ba79-4234-88e6-f23803faf510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:36.625306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b169d9e-ba79-4234-88e6-f23803faf510 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:36.625743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b169d9e-ba79-4234-88e6-f23803faf510 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:36.626331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b169d9e-ba79-4234-88e6-f23803faf510 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:36.641252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b169d9e-ba79-4234-88e6-f23803faf510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8b169d9e-ba79-4234-88e6-f23803faf510 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:36.651474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:36.652830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:36.653782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:36.656477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 296/609] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:36.665058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b169d9e-ba79-4234-88e6-f23803faf510 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:36.698808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2ff42-1c87-41a0-9159-ff26c6ad2a47 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:36.739851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2520-f076-4d2c-87e7-c9fe7ab19cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:36.740999 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2520-f076-4d2c-87e7-c9fe7ab19cba None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:36.741403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2520-f076-4d2c-87e7-c9fe7ab19cba None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:36.741788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2520-f076-4d2c-87e7-c9fe7ab19cba None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/47783bb7d4cc41c6ac4c1adb682b093b/roles/5959b7a9b03c486fb50a3eafef4d3baf` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:36.760181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd2520-f076-4d2c-87e7-c9fe7ab19cba None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=47783bb7d4cc41c6ac4c1adb682b093b, role_id=5959b7a9b03c486fb50a3eafef4d3baf)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:36.761986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd2520-f076-4d2c-87e7-c9fe7ab19cba None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:36.811231 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b169d9e-ba79-4234-88e6-f23803faf510 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:36.848882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427d0d4-4c0e-47a6-b7af-60b2b0f83054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:36.849974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d0d4-4c0e-47a6-b7af-60b2b0f83054 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:36.850469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d0d4-4c0e-47a6-b7af-60b2b0f83054 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:36.850966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427d0d4-4c0e-47a6-b7af-60b2b0f83054 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:36.852753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d0d4-4c0e-47a6-b7af-60b2b0f83054 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:36.853337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d0d4-4c0e-47a6-b7af-60b2b0f83054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:36.854957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427d0d4-4c0e-47a6-b7af-60b2b0f83054 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:36.871327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 314/610] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:23:36 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/47783bb7d4cc41c6ac4c1adb682b093b/roles/5959b7a9b03c486fb50a3eafef4d3baf => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:36.872263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 297/611] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:36.882185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2520-f076-4d2c-87e7-c9fe7ab19cba None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:37.010192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:37.052903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2520-f076-4d2c-87e7-c9fe7ab19cba None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:37.119628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:37.120454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.120741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.121023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.135217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d08b8-2b12-4e0a-9acf-b07b1289f9ae None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.135541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d08b8-2b12-4e0a-9acf-b07b1289f9ae None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.135769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d08b8-2b12-4e0a-9acf-b07b1289f9ae None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.137175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 298/612] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:37.142906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5687-5c3d-4882-9214-cdaba7b82b43 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.143233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:37.143692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5687-5c3d-4882-9214-cdaba7b82b43 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.144176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f5687-5c3d-4882-9214-cdaba7b82b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.144696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:37.163311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-169f5687-5c3d-4882-9214-cdaba7b82b43 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:37.165194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-169f5687-5c3d-4882-9214-cdaba7b82b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:37.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:37.170535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:37.171437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:37.171437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:37.171437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:37.171437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:37.178376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 315/613] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:37.179357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:37.203368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:37.250609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 299/614] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 22:23:37.275444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f5687-5c3d-4882-9214-cdaba7b82b43 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:37.340835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d5d7e-bef8-4cfc-9622-7848f79926a3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:37.380205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f5687-5c3d-4882-9214-cdaba7b82b43 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:37.389451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:37.411338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:37.412016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.412310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.412587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.413343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:37.413620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:37.415061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:37.419536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940c1a1-1249-4d92-ac98-17c92685e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:37.420602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c1a1-1249-4d92-ac98-17c92685e413 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.421076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c1a1-1249-4d92-ac98-17c92685e413 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.421552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940c1a1-1249-4d92-ac98-17c92685e413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.432297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940c1a1-1249-4d92-ac98-17c92685e413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8940c1a1-1249-4d92-ac98-17c92685e413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:37.440369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:37.441314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:37.442573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:37.444655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 316/615] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:37.446273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 300/616] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:37.450632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:37.452327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940c1a1-1249-4d92-ac98-17c92685e413 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:37.482846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:37.559522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940c1a1-1249-4d92-ac98-17c92685e413 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:37.595795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:37.596923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.597422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.597885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.598854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:37.599363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:37.601072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:37.614251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 301/617] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:37.615759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:37.667067 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc2ecc-1600-40de-bb34-8b1af6a8abff None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:37.708773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:37.709563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.709841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.710144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.718209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:37.719656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:37.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:37.737564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:37.738581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 317/618] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:37.743945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:37.771611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:37.795516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915beb6-571c-4323-aa7c-69808f592b41 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:37.818479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:37.864313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:37.865168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.865452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.865723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.881717 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:37.886099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:37.901019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15dd41-514a-4e19-9aaf-3d6c2f3d23ea None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:37.919815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:37.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:37.921741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:37.921741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:37.921741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:37.921741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:37.921741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 302/619] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:37.927936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:37.971261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:37.971931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:37.972212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:37.972488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:37.973328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:37.973633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:37.975437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:38.014844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 318/620] 10.222.0.70 () {56 vars in 1135 bytes} [Wed May 18 22:23:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:38.019372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:38.105768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a5f0d-6f05-477f-b613-f9b74acef6f4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:38.158710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:38.159376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:38.159650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:38.159919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:38.160639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:38.160936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:38.162340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:38.183064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 303/621] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:38.190985 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:38.198440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:38.240310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18bb11-2db6-4a40-a53d-f120c68d1f13 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:38.250270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:38.286781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:38.288527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:38.289269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:38.290032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:38.302543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:38.304119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:38.344092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:38.345227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:38.346326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:38.346326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:38.346326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:38.346326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:38.352681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 319/622] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:38.358091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:38.387819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49087670-2d4b-4250-b365-dc8f7c393f26 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:38.472280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d02778-6b84-4d74-9e0d-a2d3fbcf5675 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:38.488736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:38.489558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:38.489837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:38.490141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:38.509085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:38.512194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:38.538187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:38.538847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:38.539675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:38.539967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:38.540803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:38.541110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:38.542512 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:38.546137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:38.547330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 22:23:38.549263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:38.554041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 304/623] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:38.554324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:38.570080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 320/624] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:38.578652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:38.618465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:38.683496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:38.737129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78114a-ba6f-48da-b7ea-adff57c60400 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:38.744939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8079c6-4992-44cb-81c4-ded4108de86f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:38.779884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51205804-1628-4eb4-9317-e622cfc06c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:38.780549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205804-1628-4eb4-9317-e622cfc06c7e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:38.780904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a6fb0-115b-46a2-a09d-c3d95da1084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:38.781129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205804-1628-4eb4-9317-e622cfc06c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:38.781279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205804-1628-4eb4-9317-e622cfc06c7e None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:38.781688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a6fb0-115b-46a2-a09d-c3d95da1084f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:38.781970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a6fb0-115b-46a2-a09d-c3d95da1084f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:38.782156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51205804-1628-4eb4-9317-e622cfc06c7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:38.782299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a6fb0-115b-46a2-a09d-c3d95da1084f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:38.782570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51205804-1628-4eb4-9317-e622cfc06c7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:38.784012 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51205804-1628-4eb4-9317-e622cfc06c7e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:38.789954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a6fb0-115b-46a2-a09d-c3d95da1084f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:38.791496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a6fb0-115b-46a2-a09d-c3d95da1084f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:38.804348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 305/625] 10.222.0.70 () {56 vars in 1137 bytes} [Wed May 18 22:23:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:38.806407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b526f-a813-4885-a6a9-2fc50a65d5a6 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:38.806690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b526f-a813-4885-a6a9-2fc50a65d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:38.806960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b526f-a813-4885-a6a9-2fc50a65d5a6 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-fa9a6fb0-115b-46a2-a09d-c3d95da1084f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:38.807496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:38.809282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:38.811390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:38.811390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:38.811390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:38.811390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:38.811390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:38.811390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:38.811390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:38.811390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:38.816505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 306/627] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:38.816505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b526f-a813-4885-a6a9-2fc50a65d5a6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:38.816868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 321/627] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:38.816868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486a04-690f-4e82-8b14-ff3595438f16 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:38.816868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486a04-690f-4e82-8b14-ff3595438f16 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:38.816868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91486a04-690f-4e82-8b14-ff3595438f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:38.834748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-91486a04-690f-4e82-8b14-ff3595438f16 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:38.836359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-91486a04-690f-4e82-8b14-ff3595438f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:38.917376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 322/628] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:38.918304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486a04-690f-4e82-8b14-ff3595438f16 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:38.939409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:38.960325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b526f-a813-4885-a6a9-2fc50a65d5a6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:38.984502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:39.000187 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723e78d-1a47-48de-b575-2c416a1e6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.000842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723e78d-1a47-48de-b575-2c416a1e6d7b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.001124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723e78d-1a47-48de-b575-2c416a1e6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.001402 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723e78d-1a47-48de-b575-2c416a1e6d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.077552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91486a04-690f-4e82-8b14-ff3595438f16 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:39.092223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723e78d-1a47-48de-b575-2c416a1e6d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:39.094876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723e78d-1a47-48de-b575-2c416a1e6d7b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:39.119920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.120926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.121269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.121529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.122331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:39.122856 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:39.127328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:39.142043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 323/629] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:39.142043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:39.208162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 307/630] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:39.209161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:39.209389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3fd6-4995-4767-b87c-95b0ca357642 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.209679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3fd6-4995-4767-b87c-95b0ca357642 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.209958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f3fd6-4995-4767-b87c-95b0ca357642 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.211302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 308/631] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:39.211984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f3fd6-4995-4767-b87c-95b0ca357642 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:39.236395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:39.248723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c310f-3389-4d3f-ae10-ec02a5f92657 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:39.287461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ceb86-d2a0-477f-ae47-44d8c91d0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.288372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ceb86-d2a0-477f-ae47-44d8c91d0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.288656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ceb86-d2a0-477f-ae47-44d8c91d0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.288938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ceb86-d2a0-477f-ae47-44d8c91d0ce2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.299948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ceb86-d2a0-477f-ae47-44d8c91d0ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-464ceb86-d2a0-477f-ae47-44d8c91d0ce2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:39.308850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:39.309968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 324/632] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:39.311040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ceb86-d2a0-477f-ae47-44d8c91d0ce2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:39.326283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f3fd6-4995-4767-b87c-95b0ca357642 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:39.364966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b55ef4-c354-4ed4-ba26-987714e7acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.365834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b55ef4-c354-4ed4-ba26-987714e7acf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.366158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b55ef4-c354-4ed4-ba26-987714e7acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.366434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b55ef4-c354-4ed4-ba26-987714e7acf9 None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/c90d79a9665b4d9f8dc1ea440882a65c/roles/5959b7a9b03c486fb50a3eafef4d3baf` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.382094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b55ef4-c354-4ed4-ba26-987714e7acf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=c90d79a9665b4d9f8dc1ea440882a65c, role_id=5959b7a9b03c486fb50a3eafef4d3baf)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:39.384040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b55ef4-c354-4ed4-ba26-987714e7acf9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:39.422065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ceb86-d2a0-477f-ae47-44d8c91d0ce2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:39.456528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 309/633] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:23:39 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/c90d79a9665b4d9f8dc1ea440882a65c/roles/5959b7a9b03c486fb50a3eafef4d3baf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:39.456528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722178-21ab-4d30-bc35-1fb6b0807c4a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.456528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722178-21ab-4d30-bc35-1fb6b0807c4a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.456528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8722178-21ab-4d30-bc35-1fb6b0807c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.459407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:39.472274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a8722178-21ab-4d30-bc35-1fb6b0807c4a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:39.473738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a8722178-21ab-4d30-bc35-1fb6b0807c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:39.474807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.475687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.475975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.476251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.494843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:39.496364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:39.523861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:39.524852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:39.525774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:39.525774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:39.525774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:39.525774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:39.528205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 325/634] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:39.530207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:39.557886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:39.563437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 310/635] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:39.564600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722178-21ab-4d30-bc35-1fb6b0807c4a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:39.670871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e51e4-7511-432f-b0dc-b9c3978f8104 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:39.676706 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8722178-21ab-4d30-bc35-1fb6b0807c4a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:39.713348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.713931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.714323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.714592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.715336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:39.715645 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:39.717034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:39.720479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0477b40-f375-4038-9cf3-28a6cc5d0173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.721350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477b40-f375-4038-9cf3-28a6cc5d0173 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.721827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477b40-f375-4038-9cf3-28a6cc5d0173 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.722845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0477b40-f375-4038-9cf3-28a6cc5d0173 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.724047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477b40-f375-4038-9cf3-28a6cc5d0173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:39.724533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477b40-f375-4038-9cf3-28a6cc5d0173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:39.725482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 326/636] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:39.726294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:39.727074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0477b40-f375-4038-9cf3-28a6cc5d0173 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:39.742713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 311/637] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:39.745349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1604-fc63-407d-83f6-4fb76cb41d15 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.745822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1604-fc63-407d-83f6-4fb76cb41d15 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.746311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1604-fc63-407d-83f6-4fb76cb41d15 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.748487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 312/638] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:39.749400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1604-fc63-407d-83f6-4fb76cb41d15 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:39.773256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:39.816688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:39.833744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442848d-595c-4b82-9e9f-dc79f0269403 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:39.862985 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1604-fc63-407d-83f6-4fb76cb41d15 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:39.870922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3d210-86e9-485e-954a-d07203c9d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.871716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3d210-86e9-485e-954a-d07203c9d874 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.871998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3d210-86e9-485e-954a-d07203c9d874 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.872387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3d210-86e9-485e-954a-d07203c9d874 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.883613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3d210-86e9-485e-954a-d07203c9d874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8df3d210-86e9-485e-954a-d07203c9d874 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:39.892161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:39.893183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:39.894063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 327/639] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:39.895156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3d210-86e9-485e-954a-d07203c9d874 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:39.901587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61216129-4719-4098-b2aa-2fa295ca98c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:39.902622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216129-4719-4098-b2aa-2fa295ca98c2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.902906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216129-4719-4098-b2aa-2fa295ca98c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.904039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61216129-4719-4098-b2aa-2fa295ca98c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.916825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61216129-4719-4098-b2aa-2fa295ca98c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:39.918324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61216129-4719-4098-b2aa-2fa295ca98c2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-61216129-4719-4098-b2aa-2fa295ca98c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:39.935328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:39.936297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:39.937229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:39.937229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:39.937229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:39.937229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:39.937229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 313/640] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:39.937952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478227-4f22-461f-aca5-3ccfbc3df2db None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:39.937952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478227-4f22-461f-aca5-3ccfbc3df2db None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:39.938222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478227-4f22-461f-aca5-3ccfbc3df2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:39.955632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b7478227-4f22-461f-aca5-3ccfbc3df2db None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:39.956788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b7478227-4f22-461f-aca5-3ccfbc3df2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:40.018403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3d210-86e9-485e-954a-d07203c9d874 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.019972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:40.038357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 314/641] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:40.039314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478227-4f22-461f-aca5-3ccfbc3df2db None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.062993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.063785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.064059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.064329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.072246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.073683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:40.087905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:40.089140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 328/642] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:40.090424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.099405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:40.161390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478227-4f22-461f-aca5-3ccfbc3df2db None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.197385 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.198069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.198348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.198620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b5e04-1109-4aa5-84ba-1f3b08aac007 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.198753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.199350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:40.199649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.201016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.209084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 315/643] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:40.209893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.239126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.240106 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.240630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.240976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.241717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:40.242042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.243450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.259587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 329/644] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:40.259587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.285482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:40.320125 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca689c67-4e6b-4ea0-a31b-7f651b902299 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.323345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:40.357788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c62671-949e-4f27-8f84-075830d50ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.358907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c62671-949e-4f27-8f84-075830d50ffc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.359390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c62671-949e-4f27-8f84-075830d50ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.359862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c62671-949e-4f27-8f84-075830d50ffc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.371266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c62671-949e-4f27-8f84-075830d50ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:40.378155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760cc3-37c9-4113-a66c-ae1099efd99f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-43c62671-949e-4f27-8f84-075830d50ffc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:40.379408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:40.380377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:40.381298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:40.384372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 316/645] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:40.385440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c62671-949e-4f27-8f84-075830d50ffc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.419104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.419774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.420086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.420396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.421293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:40.421487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.422865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.437102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 330/646] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:40.437710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.499929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c62671-949e-4f27-8f84-075830d50ffc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.524048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:40.547596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.547596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.547596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.547596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.547972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786d9ae-a026-4c89-8e37-66751e5ee044 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.552429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.554025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:40.573175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:40.574169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:40.575084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:40.575084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:40.575084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:40.575084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:40.575084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 317/647] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:40.575376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.587416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.588473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.588755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.589034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.595137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:40.596779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.598281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:40.612924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:40.614303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:40.615597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:40.619819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 331/648] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:40.620645 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.681950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c65fb-3218-4457-b770-949c13d1e9d0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.717950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.718651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.718911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.719179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.719922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:40.720220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.721574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.723304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474645d2-4594-4edc-8af6-e25a4bbe708b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.734084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 318/649] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:40.734084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.765425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.766251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.766642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.766928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.767754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=cc7d46c2766b4481963adefebea94c09) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:40.768109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.769548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.776360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 332/650] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/role_assignments?user.id=cc7d46c2766b4481963adefebea94c09&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:40.777146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.801234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:40.846423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:40.858634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54909327-cf16-4b60-9f4a-07aa1a630eae None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.907484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.908411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.908841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.909259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.910748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:40.911247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.913384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.927005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a01ae-2e5a-4983-b323-3cc79c4c179f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:40.927752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 319/651] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:40.933600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:40.968630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:40.969571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:40.969997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:40.970438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:40.971416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:40.971950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:40.973694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:40.995540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 333/652] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:40.996349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:41.055040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e7935-1e67-4460-9b41-efd1ca1e0e5f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.080590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:41.106813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.107867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.108214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.108562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.123523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.125246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.128266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621ad81-b183-43b3-8d88-2c3905542ec6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.132434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:41.147246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:41.149930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:41.151061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:41.151061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:41.151061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:41.151061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:41.156986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 320/653] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:41.157493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:41.174272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.177079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.177079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.177079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.183042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.184464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:41.200206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:41.204006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 334/654] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:41.205142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:41.270540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fecd7-af28-4d6a-93b3-907d8ec11bdf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.307199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec2041-4347-4196-a5f6-00049c848029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.308081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec2041-4347-4196-a5f6-00049c848029 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.308508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec2041-4347-4196-a5f6-00049c848029 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.308915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec2041-4347-4196-a5f6-00049c848029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.309098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2bbc3-558f-4a03-8090-6d8b04258c74 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.334942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:41.347462 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.348198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.352178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.352178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.352178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:41.352178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.352178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.368527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 335/655] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:41.369546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:41.372965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:41.384551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec2041-4347-4196-a5f6-00049c848029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.386334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec2041-4347-4196-a5f6-00049c848029 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.479743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a83e-67a3-40bc-9079-ffc8a294f423 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.499106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 321/656] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:41.500211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec2041-4347-4196-a5f6-00049c848029 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:41.515612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.516589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.516710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.516901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.517751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:41.518064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.519479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.539820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 336/657] 10.222.0.70 () {56 vars in 1137 bytes} [Wed May 18 22:23:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:41.540848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:41.591806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:41.602792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:41.612671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec2041-4347-4196-a5f6-00049c848029 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.650814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.651855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.652285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.652698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.654236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc65169-b007-4270-96b3-cbb2a88d4a83 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.660626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.662312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:41.678047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:41.679272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 22:23:41.681127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:41.683377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 322/658] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:41.684312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:41.697303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.697936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.698267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.698541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.709730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.711225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:41.730403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:41.731559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:41.732655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:41.732655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:41.732655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:41.732655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:41.736172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 337/659] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:41.737076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:41.795085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0245-41d0-4fce-93c1-d536924ea810 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.828488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64f983-0bb3-4f6f-85dc-f088ed803eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.829124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f983-0bb3-4f6f-85dc-f088ed803eea None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.829401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f983-0bb3-4f6f-85dc-f088ed803eea None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.829672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64f983-0bb3-4f6f-85dc-f088ed803eea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.837244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:41.845350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e490fd0-4b45-4767-96a3-3319c67accf7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:41.848317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:41.881791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:41.882555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:41.883416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:41.883689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:41.884512 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:41.884813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.886242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.902641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f983-0bb3-4f6f-85dc-f088ed803eea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:41.908721 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64f983-0bb3-4f6f-85dc-f088ed803eea None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:41.908858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 338/660] 10.222.0.70 () {56 vars in 1139 bytes} [Wed May 18 22:23:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:41.908858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.008209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34cd00-6cee-4e6b-b462-c0d345078ae2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.012956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 323/661] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:42.014323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1dba-1fb9-481b-b844-8b491131d8e5 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.014607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1dba-1fb9-481b-b844-8b491131d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.014879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e1dba-1fb9-481b-b844-8b491131d8e5 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.020030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 324/662] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:42.020030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e1dba-1fb9-481b-b844-8b491131d8e5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.050402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.051355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.051766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.052162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.052881 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:42.053249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:42.058801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:42.076654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 339/663] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:42.076654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.085606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:42.089609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:42.143246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e1dba-1fb9-481b-b844-8b491131d8e5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.177700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b848a7-b228-456a-b3c2-2db50b1c9fde None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.179104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd8bd-52f6-4d3a-bd63-e639d67d4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.180322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd8bd-52f6-4d3a-bd63-e639d67d4c81 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.181417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd8bd-52f6-4d3a-bd63-e639d67d4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.181417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfd8bd-52f6-4d3a-bd63-e639d67d4c81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.215792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e8d3a-993a-47d5-a70b-8a4ef23467e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.216577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8d3a-993a-47d5-a70b-8a4ef23467e4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.216851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8d3a-993a-47d5-a70b-8a4ef23467e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.217123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e8d3a-993a-47d5-a70b-8a4ef23467e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.236629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8d3a-993a-47d5-a70b-8a4ef23467e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:42.238294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e8d3a-993a-47d5-a70b-8a4ef23467e4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:42.253165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfd8bd-52f6-4d3a-bd63-e639d67d4c81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:42.254642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfd8bd-52f6-4d3a-bd63-e639d67d4c81 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-063e8d3a-993a-47d5-a70b-8a4ef23467e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:42.255585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:42.256427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:42.257332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:42.257332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:42.257332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:42.257332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:42.257332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 340/664] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:42.258256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252ef45-026b-483c-9894-2d14610d0a49 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.258358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252ef45-026b-483c-9894-2d14610d0a49 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.258615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252ef45-026b-483c-9894-2d14610d0a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.275648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a252ef45-026b-483c-9894-2d14610d0a49 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:42.276834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a252ef45-026b-483c-9894-2d14610d0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:42.315232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:42.345400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:42.354693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 341/665] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:42.355651 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252ef45-026b-483c-9894-2d14610d0a49 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.381719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 325/666] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:42.383434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd8bd-52f6-4d3a-bd63-e639d67d4c81 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.468621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252ef45-026b-483c-9894-2d14610d0a49 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.498841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfd8bd-52f6-4d3a-bd63-e639d67d4c81 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.503188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.503980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.504259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.504533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.512085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:42.513529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:42.527790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:42.528707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:42.529630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 342/667] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:42.530787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.538142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.538797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.539210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.539513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.540230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:42.540534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:42.541893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:42.558157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 326/668] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:42.558157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.567244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:42.595634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:42.642883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdebcc-4cab-4929-a61f-5e21f9a2eaca None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.666676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d69c4-ad8b-428f-b161-af7cf77c8506 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.677553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c980b-e188-4ea3-9da9-756af4bbe1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.678403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c980b-e188-4ea3-9da9-756af4bbe1cb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.678687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c980b-e188-4ea3-9da9-756af4bbe1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.678963 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c980b-e188-4ea3-9da9-756af4bbe1cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.689232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c980b-e188-4ea3-9da9-756af4bbe1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f74c980b-e188-4ea3-9da9-756af4bbe1cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:42.697769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:42.698774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:42.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 343/669] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:42.700330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c980b-e188-4ea3-9da9-756af4bbe1cb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.708621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.709423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.709725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.709969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.720942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:42.722359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:42.741573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:42.747438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:42.748528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:42.748528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:42.748528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:42.748528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:42.748528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 327/670] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:42.748528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.813918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:42.814831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c980b-e188-4ea3-9da9-756af4bbe1cb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.830206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:42.853242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.854243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.856183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacca1b3-32ae-4600-9136-8313933f4a96 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:42.856560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.856938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.858869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:42.859184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:42.860614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:42.877630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 344/671] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:42.877630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.898199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:42.899620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:42.900140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:42.900487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:42.908190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:42.910441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:42.929158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:42.930325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:42.931388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 328/672] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:42.931884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:42.991883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad25b2-e945-40c5-b598-48a095427947 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.034025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.034886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.035263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.035644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.036485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:43.036865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.038353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.039038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e911147-d843-418c-b902-4f1a72bf46ea None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.049051 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 345/673] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:43.050041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.070699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:43.082919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.083642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.083988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.084322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.085192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:43.085555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.087593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.090885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:43.105177 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 329/674] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:43.105843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.158834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30794c-1042-4239-a47e-317deaabf7f2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.196522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.197700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.198126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.198470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.199366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=55b3fcbfb08544d482bd0bea4b3d3f0f) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:43.199763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.201448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.207266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 346/675] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/role_assignments?user.id=55b3fcbfb08544d482bd0bea4b3d3f0f&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:43.208036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.220193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6352bd-5f47-4c37-a0d1-33b0132c21b2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.261698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.262677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.262966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.263246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.264055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:43.264369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.265864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.283784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 330/676] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:43.283784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.327680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:43.331466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92bf81-7c8c-4f23-a494-839a439adda7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.332656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:43.372945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e85de-90a2-4557-b905-1caa8588f05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.374470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e85de-90a2-4557-b905-1caa8588f05c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.375203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e85de-90a2-4557-b905-1caa8588f05c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.375483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e85de-90a2-4557-b905-1caa8588f05c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.387942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e85de-90a2-4557-b905-1caa8588f05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.390194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e85de-90a2-4557-b905-1caa8588f05c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.392359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0a4d5-0a9d-4149-9ad6-6ca6f8a4221b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8d4e85de-90a2-4557-b905-1caa8588f05c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:43.409588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:43.410596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:43.411516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:43.411516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:43.411516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:43.411516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:43.411516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 347/677] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:43.412221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a4475-0df7-442f-bb1e-71697e6813cf None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.412387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a4475-0df7-442f-bb1e-71697e6813cf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.412937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a4475-0df7-442f-bb1e-71697e6813cf None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.414098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 348/678] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:43.418864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a4475-0df7-442f-bb1e-71697e6813cf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.437542 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.438832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.439116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.439391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.448548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.450140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:43.465327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:43.466398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:43.467331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 331/679] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:43.467866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.535000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a4475-0df7-442f-bb1e-71697e6813cf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.571113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706530ce-00b7-487d-bba4-fe11279306a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.571992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706530ce-00b7-487d-bba4-fe11279306a6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.572267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706530ce-00b7-487d-bba4-fe11279306a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.572543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706530ce-00b7-487d-bba4-fe11279306a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.573398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706530ce-00b7-487d-bba4-fe11279306a6 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=fe4941cd1afb4318b42263390025d198) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:43.573709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706530ce-00b7-487d-bba4-fe11279306a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.575225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706530ce-00b7-487d-bba4-fe11279306a6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.590468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 349/680] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/role_assignments?user.id=fe4941cd1afb4318b42263390025d198&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:43.590468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2417f-cbcb-4f73-86cf-239ab88cced5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.590468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2417f-cbcb-4f73-86cf-239ab88cced5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.590468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2417f-cbcb-4f73-86cf-239ab88cced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.611998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c0a2417f-cbcb-4f73-86cf-239ab88cced5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:43.613281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c0a2417f-cbcb-4f73-86cf-239ab88cced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:43.627495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:43.705392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 350/681] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:43.705392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2417f-cbcb-4f73-86cf-239ab88cced5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.724783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d62dc-6101-4493-853c-47d052ab434c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.727420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:43.776767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.777997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.778488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.778902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.780060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:43.781022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.782872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.800377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 332/682] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:43.801811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.855881 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2417f-cbcb-4f73-86cf-239ab88cced5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.900740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.901408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.901739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.902035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.902841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:43.903154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:43.904588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:43.918556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 351/683] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:43.919381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:43.933668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:43.934889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db04eb-47f5-4823-81e0-17a43a5240c7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:43.982596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:43.983422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:43.983695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:43.983970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:43.999737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:44.001478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:44.026347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:44.027338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:44.028268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:44.028268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:44.028268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:44.028268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:44.028801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 333/684] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:44.034027 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:44.039339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4991db7-0b8d-43aa-8534-7001081caf8f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:44.060824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:44.088200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:44.089960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:44.090394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:44.091373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:44.099567 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:44.102185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:44.119292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:44.124247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 352/685] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:44.125439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:44.170674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e428646-e86d-4e0e-bc78-1fdd47626c22 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:44.206885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:44.216936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:44.217789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:44.218748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:44.219178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:44.220657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=47783bb7d4cc41c6ac4c1adb682b093b) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:44.221128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:44.223416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:44.231738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 334/686] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:44 2022] GET /identity/v3/role_assignments?user.id=47783bb7d4cc41c6ac4c1adb682b093b&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:44.233136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:44.250250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c96b66-5617-4109-97f9-590c7859cd38 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:44.299904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:44.302546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:44.303130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:44.303618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:44.305554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:44.306190 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:44.308000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:44.322502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:44.325911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 353/687] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:44.331450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:44.344004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8ebb3-b7b6-4a30-9d6e-3d835e26f067 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:44.424675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:44.425691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:44.426133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:44.426534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:44.427515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:44.427948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:44.429621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:44.455747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 335/688] 10.222.0.70 () {56 vars in 1135 bytes} [Wed May 18 22:23:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:44.457282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:44.516028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9afb1-a72d-483b-b638-ca5b65484411 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:44.552144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:44.563863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ecb77-8f83-46ae-943a-e7b544763097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:44.569960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ecb77-8f83-46ae-943a-e7b544763097 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:44.569960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ecb77-8f83-46ae-943a-e7b544763097 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:44.569960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ecb77-8f83-46ae-943a-e7b544763097 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:44.569960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ecb77-8f83-46ae-943a-e7b544763097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:44.569960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ecb77-8f83-46ae-943a-e7b544763097 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:44.577839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41b7eb-8e24-4bae-a87f-7f94010ec0ab None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:44.620214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28a040-eec4-4efc-b2a1-aa0b35556303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:44.621138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a040-eec4-4efc-b2a1-aa0b35556303 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:44.621415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a040-eec4-4efc-b2a1-aa0b35556303 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:44.621685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28a040-eec4-4efc-b2a1-aa0b35556303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:44.626407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:44.677401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 354/689] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:23:44 2022] POST /identity/v3/users => generated 254 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:44.703552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28a040-eec4-4efc-b2a1-aa0b35556303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:44.705211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28a040-eec4-4efc-b2a1-aa0b35556303 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:44.830049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 336/690] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 22:23:44.832010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ecb77-8f83-46ae-943a-e7b544763097 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:44.981703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ecb77-8f83-46ae-943a-e7b544763097 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:45.017509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:45.018708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:45.019216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:45.019727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:45.031627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:45.033425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:45.051540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:45.052507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:45.053421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:45.053421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:45.053421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:45.053421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:45.056291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 355/691] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:45.062298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28a040-eec4-4efc-b2a1-aa0b35556303 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:45.111449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:45.187146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28a040-eec4-4efc-b2a1-aa0b35556303 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:45.224299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:45.225304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:45.225787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:45.226320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:45.227433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:45.227961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:45.229598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:45.243274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 337/692] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:45.251097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:45.288621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:45.372052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a2e5-d591-4cfe-8abd-ca0170ca1f04 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:45.408041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:45.408837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:45.409125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:45.409406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:45.417109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:45.418707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:45.434544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:45.435725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:45.437278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 356/693] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:45.443404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:45.549656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:45.559861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831220e-0eb9-437e-97c3-37acb6dd5414 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:45.603606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb3e01-4607-40a6-bbed-2060fae10018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:45.604274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3e01-4607-40a6-bbed-2060fae10018 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:45.604551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3e01-4607-40a6-bbed-2060fae10018 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:45.604815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb3e01-4607-40a6-bbed-2060fae10018 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:45.605600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb3e01-4607-40a6-bbed-2060fae10018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:45.605905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb3e01-4607-40a6-bbed-2060fae10018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:45.607366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb3e01-4607-40a6-bbed-2060fae10018 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:45.623035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 338/694] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:45.628724 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:45.728719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a2d7-2d62-4eab-b0e0-2f866b827941 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:45.729044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a2d7-2d62-4eab-b0e0-2f866b827941 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:45.729265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34a2d7-2d62-4eab-b0e0-2f866b827941 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:45.730041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:45.735510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 339/695] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:45.736577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d655961-7ed1-4d4a-b8bd-c3e23314d375 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:45.737173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9ba1-3f96-479b-a36a-572da0cdddfa None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:45.737649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9ba1-3f96-479b-a36a-572da0cdddfa None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:45.738143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc9ba1-3f96-479b-a36a-572da0cdddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:45.774049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:45.774720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:45.775421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4ecc9ba1-3f96-479b-a36a-572da0cdddfa None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:45.775682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:45.776078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:45.777071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=c90d79a9665b4d9f8dc1ea440882a65c) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:45.777187 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4ecc9ba1-3f96-479b-a36a-572da0cdddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:45.777561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:45.779137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:45.786398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 357/696] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:45 2022] GET /identity/v3/role_assignments?user.id=c90d79a9665b4d9f8dc1ea440882a65c&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:45.857347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 340/697] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:45.889116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.006901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2991505-5341-4be5-aee3-b47e442b9846 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:46.050027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7dd8a-33a0-469b-974f-b6de90b428a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:46.050027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7dd8a-33a0-469b-974f-b6de90b428a6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.050027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7dd8a-33a0-469b-974f-b6de90b428a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.050027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a7dd8a-33a0-469b-974f-b6de90b428a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.057498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a7dd8a-33a0-469b-974f-b6de90b428a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-11a7dd8a-33a0-469b-974f-b6de90b428a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:46.065263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:46.066250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:46.067325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 358/698] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:46.073135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9ba1-3f96-479b-a36a-572da0cdddfa None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.183708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:46.200592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc9ba1-3f96-479b-a36a-572da0cdddfa None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:46.236169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003f60f-a124-4d48-b777-79718cb8918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:46.236839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f60f-a124-4d48-b777-79718cb8918d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.237120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f60f-a124-4d48-b777-79718cb8918d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.237393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003f60f-a124-4d48-b777-79718cb8918d None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.238162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f60f-a124-4d48-b777-79718cb8918d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:46.238469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f60f-a124-4d48-b777-79718cb8918d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:46.239840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003f60f-a124-4d48-b777-79718cb8918d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:46.249996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 341/699] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:46.255100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7dd8a-33a0-469b-974f-b6de90b428a6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.276873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:46.357908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebfa88-ccd9-44ae-abc5-a8b144802bfe None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.358254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebfa88-ccd9-44ae-abc5-a8b144802bfe None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.358526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebfa88-ccd9-44ae-abc5-a8b144802bfe None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.360051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 342/700] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:46.364804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a7dd8a-33a0-469b-974f-b6de90b428a6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:46.365763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccbd6-9144-4d3e-a1b6-eb240884c004 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.366286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccbd6-9144-4d3e-a1b6-eb240884c004 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.366763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccbd6-9144-4d3e-a1b6-eb240884c004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.388544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c57ccbd6-9144-4d3e-a1b6-eb240884c004 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:46.390220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c57ccbd6-9144-4d3e-a1b6-eb240884c004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:46.401464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:46.402287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.402567 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.402841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.415145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:46.416629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:46.436366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:46.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:46.438793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:46.438793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:46.438793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:46.438793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:46.438793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 359/701] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:46.443434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.478071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 343/702] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:46.497049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccbd6-9144-4d3e-a1b6-eb240884c004 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.546423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:46.556485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb313d0-bca4-4fd8-903b-df275acd12f0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:46.581506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:46.595934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:46.596696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.596993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.597272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.598030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:46.598350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:46.600593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:46.604929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccbd6-9144-4d3e-a1b6-eb240884c004 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:46.616601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 360/703] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:46.622403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.642722 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:46.643965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.644302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.644636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.645348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:46.646862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:46.661677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:46.662819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:46.663789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:46.668210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 344/704] 10.222.0.70 () {56 vars in 1129 bytes} [Wed May 18 22:23:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:46.669456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.744409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9588d-501f-4158-ab0b-0b9e5fbc89af None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:46.778367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:46.786674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:46.787683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.787972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.788253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.797230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:46.798909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:46.815459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:46.816525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:46.817596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 361/705] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:23:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:46.827050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.857501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a31d8-2870-4eaf-be66-31ecc5770f47 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:46.903071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:46.904157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.904690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.905180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.906217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:46.906822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:46.908410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:46.920971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 345/706] 10.222.0.70 () {56 vars in 1124 bytes} [Wed May 18 22:23:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:46.926042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:46.939892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd424f9a-ba96-4a69-b93e-f2e5ef0368c3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:46.951560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:46.977943 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:46.978792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:46.979084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:46.979370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:46.980226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:46.980541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:46.982129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:47.002046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 362/707] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:23:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:47.011097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:47.110410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:47.136256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d00b8b-b542-4600-897e-9065a45055f5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:47.189075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513014-61ac-4a51-870a-4dddb5ff2c2b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:47.202545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a481fa-3298-4f02-bf70-018532907127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:47.203230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a481fa-3298-4f02-bf70-018532907127 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.203506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a481fa-3298-4f02-bf70-018532907127 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.203776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a481fa-3298-4f02-bf70-018532907127 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.204568 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a481fa-3298-4f02-bf70-018532907127 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:47.204878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a481fa-3298-4f02-bf70-018532907127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:47.206387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a481fa-3298-4f02-bf70-018532907127 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:47.220447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 346/708] 10.222.0.70 () {56 vars in 1124 bytes} [Wed May 18 22:23:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:47.244847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc8fd5-8f4f-4601-bef5-af9a74487969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:47.245611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc8fd5-8f4f-4601-bef5-af9a74487969 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.246143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc8fd5-8f4f-4601-bef5-af9a74487969 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.246419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc8fd5-8f4f-4601-bef5-af9a74487969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.338388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc8fd5-8f4f-4601-bef5-af9a74487969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:47.339745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc8fd5-8f4f-4601-bef5-af9a74487969 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:47.399985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:47.453436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4fefa-f86a-4af2-8abf-c37095c4e376 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.453770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4fefa-f86a-4af2-8abf-c37095c4e376 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.453975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4fefa-f86a-4af2-8abf-c37095c4e376 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.455475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 347/709] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:47.464825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c7fd-8de4-4a91-9fae-6a4cdba08ff1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.465192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c7fd-8de4-4a91-9fae-6a4cdba08ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.465542 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c7fd-8de4-4a91-9fae-6a4cdba08ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.480145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 363/710] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:47.485780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc8fd5-8f4f-4601-bef5-af9a74487969 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:47.498161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1a71c7fd-8de4-4a91-9fae-6a4cdba08ff1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:47.499502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1a71c7fd-8de4-4a91-9fae-6a4cdba08ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:47.611824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc8fd5-8f4f-4601-bef5-af9a74487969 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:47.653726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7f8a-aab3-4488-9166-a99019d84c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:47.654889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7f8a-aab3-4488-9166-a99019d84c80 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.655834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7f8a-aab3-4488-9166-a99019d84c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.656365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7f8a-aab3-4488-9166-a99019d84c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.669670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:47.670117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee7f8a-aab3-4488-9166-a99019d84c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:47.672219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee7f8a-aab3-4488-9166-a99019d84c80 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:47.675937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 348/711] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-29ee7f8a-aab3-4488-9166-a99019d84c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:47.695345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:47.697129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:47.698076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:47.698076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:47.698076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:47.698076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:47.700392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 364/712] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:47.700732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:47.706300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c7fd-8de4-4a91-9fae-6a4cdba08ff1 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:47.707800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f1229-3aed-46fe-90af-27fc5de6333a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.708087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f1229-3aed-46fe-90af-27fc5de6333a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.708363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f1229-3aed-46fe-90af-27fc5de6333a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.712301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 365/713] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:47.712301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f1229-3aed-46fe-90af-27fc5de6333a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:47.836481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f1229-3aed-46fe-90af-27fc5de6333a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:47.837395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c7fd-8de4-4a91-9fae-6a4cdba08ff1 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:47.873764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23174c1-c6f3-4b35-9262-0e9b4fee4678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:47.874506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23174c1-c6f3-4b35-9262-0e9b4fee4678 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.874921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23174c1-c6f3-4b35-9262-0e9b4fee4678 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.875282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23174c1-c6f3-4b35-9262-0e9b4fee4678 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.876103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23174c1-c6f3-4b35-9262-0e9b4fee4678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:47.876468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23174c1-c6f3-4b35-9262-0e9b4fee4678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:47.877897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23174c1-c6f3-4b35-9262-0e9b4fee4678 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:47.881638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:47.882459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.882820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.883094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] PATH_INFO: `/v3/services/network` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.883738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:47.885646 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:47.890922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 349/714] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:47.892557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa785a-300b-422a-96de-cfa1742eff45 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:47.892907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa785a-300b-422a-96de-cfa1742eff45 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:47.893247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa785a-300b-422a-96de-cfa1742eff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:47.906504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:47.907633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:47.908490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:47.912115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-57fa785a-300b-422a-96de-cfa1742eff45 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:47.912803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 366/715] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:47 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:47.913639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:47.913796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-57fa785a-300b-422a-96de-cfa1742eff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:47.973758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:47.994592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:47.994821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 350/716] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:47.996067 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa785a-300b-422a-96de-cfa1742eff45 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:48.160013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f77dc-b445-4ee6-bfce-9f344e6de51b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.187186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa785a-300b-422a-96de-cfa1742eff45 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.204852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:48.206048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.206558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.207048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.214576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:48.216267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:48.228904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:48.229601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.229881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.230197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.230900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] RBAC: Adding query filter params (name=network) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:48.231199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:48.232693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:48.233251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:48.234198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:48.235118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:48.235118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:48.235118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:48.235118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:48.235118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:48.235118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:48.235118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:48.235118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:48.237647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 367/717] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:48.238819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:48.246172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 351/718] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:23:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:48.247729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:48.308727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:48.357518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cb64b-e04b-4c84-9fc2-3027d2e0eb09 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.357755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbacc04-b349-4d1e-9419-0f5f1260db4f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.383249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:48.394502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d2f9-33fe-442b-9ce3-bc14627e03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:48.395484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d2f9-33fe-442b-9ce3-bc14627e03fb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.395815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d2f9-33fe-442b-9ce3-bc14627e03fb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.396138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8d2f9-33fe-442b-9ce3-bc14627e03fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.402683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:48.403681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.404153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.404661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.405646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:48.406183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:48.407559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8d2f9-33fe-442b-9ce3-bc14627e03fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:48.408014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a7e8d2f9-33fe-442b-9ce3-bc14627e03fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:48.417097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:48.418111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:48.418987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:48.423258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 368/719] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:48.424200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d2f9-33fe-442b-9ce3-bc14627e03fb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:48.426016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 352/720] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:48.427096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:48.535850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2731009-1aec-4735-a34e-7268f6ad93a9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.539733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8d2f9-33fe-442b-9ce3-bc14627e03fb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.552703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:48.577649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:48.578519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.578901 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.579278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.580131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:48.580424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:48.580710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:48.581381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.581798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.582256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.582629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:48.583272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] RBAC: Adding query filter params (type=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:48.583711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:48.585175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:48.598030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 353/721] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:48.598030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:48.598291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 369/722] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:23:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:48.615865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:48.686507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:48.749696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c3a6d-8641-4ed5-b18b-074e78148555 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.779693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe472-5922-4bd7-a0ba-63605ef6c657 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.797303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87320b-fd2e-4058-9c5a-94b26c06636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:48.798408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87320b-fd2e-4058-9c5a-94b26c06636a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.798707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87320b-fd2e-4058-9c5a-94b26c06636a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.799406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87320b-fd2e-4058-9c5a-94b26c06636a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.812684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87320b-fd2e-4058-9c5a-94b26c06636a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:48.814344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87320b-fd2e-4058-9c5a-94b26c06636a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:48.824308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b667140-69cf-4f15-9f1b-ab982eb9f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:48.825510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b667140-69cf-4f15-9f1b-ab982eb9f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.825797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b667140-69cf-4f15-9f1b-ab982eb9f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.826258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b667140-69cf-4f15-9f1b-ab982eb9f3a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.827246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b667140-69cf-4f15-9f1b-ab982eb9f3a6 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=55b3fcbfb08544d482bd0bea4b3d3f0f) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:48.827561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b667140-69cf-4f15-9f1b-ab982eb9f3a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:48.829025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b667140-69cf-4f15-9f1b-ab982eb9f3a6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6f87320b-fd2e-4058-9c5a-94b26c06636a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:48.837074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:48.838027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:48.838949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:48.838949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:48.838949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:48.838949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:48.839175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 354/723] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:48 2022] GET /identity/v3/role_assignments?user.id=55b3fcbfb08544d482bd0bea4b3d3f0f&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=fe643140d2134736a54afd972d47d43f => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:48.839248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 370/724] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:48.839399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55059696-be5b-49b9-98a7-5aed2bfcc87a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.839399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55059696-be5b-49b9-98a7-5aed2bfcc87a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.839399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55059696-be5b-49b9-98a7-5aed2bfcc87a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.840039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 355/725] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:48.846247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94624a1c-2315-458a-a6c2-704b4ec1a74e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:48.846682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94624a1c-2315-458a-a6c2-704b4ec1a74e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:48.846966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94624a1c-2315-458a-a6c2-704b4ec1a74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:48.852805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55059696-be5b-49b9-98a7-5aed2bfcc87a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:48.868470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-94624a1c-2315-458a-a6c2-704b4ec1a74e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:48.870730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-94624a1c-2315-458a-a6c2-704b4ec1a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:48.904861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:48.958239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 371/726] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:48.974940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55059696-be5b-49b9-98a7-5aed2bfcc87a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:48.977652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94624a1c-2315-458a-a6c2-704b4ec1a74e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:49.012304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:49.016060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:49.016793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:49.017076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:49.017352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:49.018169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:49.018575 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:49.020109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:49.035258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 356/727] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:49.041209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:49.134842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94624a1c-2315-458a-a6c2-704b4ec1a74e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:49.176489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc56157-6b81-46e3-a83a-c473f1bdc271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:49.177284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc56157-6b81-46e3-a83a-c473f1bdc271 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:49.177548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc56157-6b81-46e3-a83a-c473f1bdc271 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:49.177813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc56157-6b81-46e3-a83a-c473f1bdc271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:49.188685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc56157-6b81-46e3-a83a-c473f1bdc271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-fcc56157-6b81-46e3-a83a-c473f1bdc271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:49.197493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:49.198536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:49.199600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 372/728] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:49.206961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc56157-6b81-46e3-a83a-c473f1bdc271 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:49.237383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:49.241914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4755f8-53e1-4474-b6ab-451cd7067b6d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:49.307918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:49.308739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:49.309810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:49.310099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:49.323236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:49.324670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:49.350832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:49.352459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:49.353946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 357/729] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:23:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:49.358759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:49.375330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:49.388060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc56157-6b81-46e3-a83a-c473f1bdc271 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:49.435399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:49.436045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:49.436324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:49.436599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:49.437350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:49.437654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:49.439052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:49.448785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 373/730] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:49.454592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:49.502181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0251f-1992-478a-a17d-3e2f973be493 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:49.571776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:49.572459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:49.572739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:49.573012 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:49.573859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:49.575170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:49.576610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:49.605808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 358/731] 10.222.0.70 () {56 vars in 1149 bytes} [Wed May 18 22:23:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:49.614840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:49.629382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59806ee6-ceb4-476d-8730-6871380e3b22 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:49.646380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:49.688370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:49.689175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:49.689498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:49.689769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:49.719274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:49.720727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:49.752375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:49.753348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:49.754298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:49.754298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:49.754298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:49.754298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:49.762623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 374/732] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:49.763626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:49.774954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:49.798367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493309-42e6-41eb-90a8-ecf46d1c8b70 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:49.836773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4350b-e31b-47c2-8161-2a39cc4fb198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:49.837767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4350b-e31b-47c2-8161-2a39cc4fb198 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:49.838073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4350b-e31b-47c2-8161-2a39cc4fb198 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:49.838381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4350b-e31b-47c2-8161-2a39cc4fb198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:49.909068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4350b-e31b-47c2-8161-2a39cc4fb198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:49.910556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4350b-e31b-47c2-8161-2a39cc4fb198 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:49.934426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:49.994732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6f3de-7afc-4682-bf05-1a40c00d805d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:50.025873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 359/733] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 22:23:50.031816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114e4b-0e4d-4c62-af83-e4dcf1436cd7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.032108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114e4b-0e4d-4c62-af83-e4dcf1436cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.032388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114e4b-0e4d-4c62-af83-e4dcf1436cd7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.037647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 360/734] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:50.037647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114e4b-0e4d-4c62-af83-e4dcf1436cd7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:50.044467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f731c08-a447-4d9b-8900-8c312f12f3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:50.045690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731c08-a447-4d9b-8900-8c312f12f3bf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.046254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731c08-a447-4d9b-8900-8c312f12f3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.046745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731c08-a447-4d9b-8900-8c312f12f3bf None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.047779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731c08-a447-4d9b-8900-8c312f12f3bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:50.048289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731c08-a447-4d9b-8900-8c312f12f3bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:50.049983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731c08-a447-4d9b-8900-8c312f12f3bf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:50.074346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 375/735] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:50.076386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177208-25fc-4a98-ac04-7ddc854c993c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.076882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177208-25fc-4a98-ac04-7ddc854c993c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.077360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177208-25fc-4a98-ac04-7ddc854c993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.096860 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d1177208-25fc-4a98-ac04-7ddc854c993c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:50.099240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d1177208-25fc-4a98-ac04-7ddc854c993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:50.176222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:50.184381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114e4b-0e4d-4c62-af83-e4dcf1436cd7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:50.192465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 376/736] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:50.193650 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1177208-25fc-4a98-ac04-7ddc854c993c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:50.213645 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:50.239220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:50.240615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.241127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.243082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.258588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:50.261034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:50.285604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:50.286589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:50.287531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:50.287531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:50.287531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:50.287531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:50.290166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 361/737] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:50.291644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:50.325646 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1177208-25fc-4a98-ac04-7ddc854c993c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:50.368927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:50.369870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.370259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.370620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.378199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:50.379775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:50.395049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:50.396247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:50.397455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:50.404187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 377/738] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:50.404187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:50.421230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc79c90-45e0-4ff8-a11e-88037b266fa7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:50.457223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be9de1-abd5-4fa8-9e90-b060bf203e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:50.458041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9de1-abd5-4fa8-9e90-b060bf203e18 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.458430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9de1-abd5-4fa8-9e90-b060bf203e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.458798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9de1-abd5-4fa8-9e90-b060bf203e18 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.459645 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be9de1-abd5-4fa8-9e90-b060bf203e18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:50.461681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be9de1-abd5-4fa8-9e90-b060bf203e18 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:50.481926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:50.535506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e95b8-4eaa-472a-809d-2d50c311251b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:50.540720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 362/739] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:23:50 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:50.542634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be9de1-abd5-4fa8-9e90-b060bf203e18 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:50.618220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:50.650951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:50.652184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.654152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.654644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.655603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:50.656185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:50.657793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:50.678125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 378/740] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:50.684163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:50.758865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be9de1-abd5-4fa8-9e90-b060bf203e18 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:50.801388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:50.801982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.802337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.802607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.803444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:50.803749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:50.805226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:50.831241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 363/741] 10.222.0.70 () {56 vars in 1135 bytes} [Wed May 18 22:23:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:50.837762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:50.857986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15ff01-25c5-4d54-ab7d-8c320eeb59b9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:50.873136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:50.905683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:50.906558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:50.906834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:50.907102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:50.914433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:50.915986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:50.932613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:50.933592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:50.934822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 379/742] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:50.940489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:50.944741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:50.962443 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50d683-5819-42cf-93b8-7b09559bc8b5 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:51.013233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fefde-08c2-4ae1-89c1-6226d8c23ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:51.013887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fefde-08c2-4ae1-89c1-6226d8c23ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.014195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fefde-08c2-4ae1-89c1-6226d8c23ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.014531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fefde-08c2-4ae1-89c1-6226d8c23ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.153884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c426e98-a644-4e87-a7d2-69f19e9d87f7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:51.194616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fefde-08c2-4ae1-89c1-6226d8c23ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:51.196288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fefde-08c2-4ae1-89c1-6226d8c23ea2 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:51.233596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:51.234304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.234596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.234870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.235663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:51.235975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:51.237396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:51.261497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 380/743] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:51.267192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:51.321335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:51.336352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 364/744] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 22:23:51.337317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:51.343323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fefde-08c2-4ae1-89c1-6226d8c23ea2 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:51.428744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b750f-ec4b-469f-9e27-98f3fd1386a0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:51.450058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fefde-08c2-4ae1-89c1-6226d8c23ea2 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:51.466343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546122e5-9a1e-4d05-87bc-c2cafa6b947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:51.466995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546122e5-9a1e-4d05-87bc-c2cafa6b947b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.467272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546122e5-9a1e-4d05-87bc-c2cafa6b947b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.467544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546122e5-9a1e-4d05-87bc-c2cafa6b947b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.468362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546122e5-9a1e-4d05-87bc-c2cafa6b947b None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=39cd155a775f496ea9dd309eb3c47af2) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:51.468673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546122e5-9a1e-4d05-87bc-c2cafa6b947b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:51.470102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546122e5-9a1e-4d05-87bc-c2cafa6b947b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:51.475426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 381/745] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:51 2022] GET /identity/v3/role_assignments?user.id=39cd155a775f496ea9dd309eb3c47af2&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:51.476712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d42b-cdda-475c-bb6a-01811359685b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.476998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d42b-cdda-475c-bb6a-01811359685b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.477271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037d42b-cdda-475c-bb6a-01811359685b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.478715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 382/746] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:51.484166 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb5df-7a1a-459a-8c05-9291a9479327 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.484446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb5df-7a1a-459a-8c05-9291a9479327 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.484719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fb5df-7a1a-459a-8c05-9291a9479327 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.490132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 383/747] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:51.490132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cd2a-4c39-4998-889d-ae3d837370a3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.490132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cd2a-4c39-4998-889d-ae3d837370a3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.490132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2cd2a-4c39-4998-889d-ae3d837370a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.500507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edac34-6dc4-4f76-9723-1663d0e32d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:51.501545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edac34-6dc4-4f76-9723-1663d0e32d06 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.501826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edac34-6dc4-4f76-9723-1663d0e32d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.502204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edac34-6dc4-4f76-9723-1663d0e32d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.508860 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0ba2cd2a-4c39-4998-889d-ae3d837370a3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:51.510538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0ba2cd2a-4c39-4998-889d-ae3d837370a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:51.514485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edac34-6dc4-4f76-9723-1663d0e32d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:51.515972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edac34-6dc4-4f76-9723-1663d0e32d06 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c2edac34-6dc4-4f76-9723-1663d0e32d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:51.536767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:51.537772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:51.539061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:51.539061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:51.539061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:51.539061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:51.539061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 365/748] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:51.539877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66047-914a-44c6-9b81-2e1d108e5cd2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.540161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66047-914a-44c6-9b81-2e1d108e5cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.540434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66047-914a-44c6-9b81-2e1d108e5cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.558477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-adb66047-914a-44c6-9b81-2e1d108e5cd2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:51.559773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-adb66047-914a-44c6-9b81-2e1d108e5cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:51.596556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 384/749] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:51.596556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cd2a-4c39-4998-889d-ae3d837370a3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:51.618314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:51.630900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:51.669526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 366/750] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 22:23:51.671000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66047-914a-44c6-9b81-2e1d108e5cd2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:51.740422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2cd2a-4c39-4998-889d-ae3d837370a3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:51.778208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:51.778873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.779154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.779426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.780146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:51.780451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:51.781937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:51.785317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66047-914a-44c6-9b81-2e1d108e5cd2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:51.794806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 385/751] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:51.795684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:51.822313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb34f85-1f0e-4200-919c-d5f90e0f1ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:51.823490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb34f85-1f0e-4200-919c-d5f90e0f1ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.823974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb34f85-1f0e-4200-919c-d5f90e0f1ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.824448 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb34f85-1f0e-4200-919c-d5f90e0f1ad7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.836791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb34f85-1f0e-4200-919c-d5f90e0f1ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-feb34f85-1f0e-4200-919c-d5f90e0f1ad7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:51.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:51.845906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:51.846868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:51.854637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 367/752] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:51.855762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb34f85-1f0e-4200-919c-d5f90e0f1ad7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:51.889238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:51.918459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337749be-27f9-478e-9d48-74d9a960779d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:51.946378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:51.963486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b309-aa4f-4a1f-85c7-01acf2b6c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:51.964484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b309-aa4f-4a1f-85c7-01acf2b6c573 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:51.965032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b309-aa4f-4a1f-85c7-01acf2b6c573 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:51.965314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b309-aa4f-4a1f-85c7-01acf2b6c573 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:51.966107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b309-aa4f-4a1f-85c7-01acf2b6c573 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:51.968116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b309-aa4f-4a1f-85c7-01acf2b6c573 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:51.971605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb34f85-1f0e-4200-919c-d5f90e0f1ad7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:52.010308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:52.011213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:52.011554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:52.011893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:52.018876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:52.020309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:52.037477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:52.038720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:52.039821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:52.039821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:52.039821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:52.039821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:52.039821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:52.039821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:52.039821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:52.039821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:52.040655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 368/753] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:52.041103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 386/754] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:23:51 2022] POST /identity/v3/services => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:52.041400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:52.042558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b309-aa4f-4a1f-85c7-01acf2b6c573 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:52.230366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:52.245140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b309-aa4f-4a1f-85c7-01acf2b6c573 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:52.251717 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b755586-55bd-4d3d-92ba-09533e93fd7b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:52.312205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:52.312874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:52.313153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:52.313425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:52.313624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:52.314239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:52.314574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:52.315004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:52.315493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:52.315957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:52.316151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:52.317997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:52.318766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:52.321401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:52.328080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:52.333640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 369/756] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:52.333776 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 387/756] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:52.339864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:52.340205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:52.457921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72fc9-8319-48bc-b721-4f2c7ea0541c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:52.462864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae36003-f1ec-44fc-8bcb-e1bb572c93ef None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:52.511918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:52.512502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:52.512783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:52.513061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:52.513894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=c90d79a9665b4d9f8dc1ea440882a65c) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:52.514231 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:52.515671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:52.519976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:52.520782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:52.521061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:52.521337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:52.528495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 370/757] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:23:52 2022] GET /identity/v3/role_assignments?user.id=c90d79a9665b4d9f8dc1ea440882a65c&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=fe643140d2134736a54afd972d47d43f => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:52.541844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:52.543362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:52.563454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:52.564452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:52.565389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:52.565389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:52.565389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:52.565389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:52.569757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 388/758] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:52.571851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:52.591448 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:52.683990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218de50-5857-4c3e-8463-48c9e2cdad3b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:52.720808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:52.721490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:52.721766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:52.722055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:52.722790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:52.723095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:52.724504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:52.741856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 371/759] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:52.743940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:52.815643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:52.893488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b8f44-1754-4303-8f22-a87540aa709c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:52.947386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5358ae-e991-4ddc-8161-fb8a247adcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:52.948179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5358ae-e991-4ddc-8161-fb8a247adcdc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:52.948464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5358ae-e991-4ddc-8161-fb8a247adcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:52.948733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5358ae-e991-4ddc-8161-fb8a247adcdc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:52.959719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5358ae-e991-4ddc-8161-fb8a247adcdc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:52.961295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5358ae-e991-4ddc-8161-fb8a247adcdc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ad5358ae-e991-4ddc-8161-fb8a247adcdc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:52.982044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:52.983079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:52.984028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:52.988465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 389/760] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:23:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:52.989915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:53.091034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:53.121109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d3afc-6ca5-4fe4-8771-f8f7d6c28434 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:53.161873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:53.162570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:53.162849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:53.163180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:53.164567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:53.164849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:53.166419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:53.176259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258fce-8a28-4979-8f18-f63e764751aa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:53.176531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258fce-8a28-4979-8f18-f63e764751aa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:53.176806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258fce-8a28-4979-8f18-f63e764751aa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:53.178409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 390/761] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:23:53.194648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527a54-13b7-4409-9635-4dff7e5916a9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:53.196118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527a54-13b7-4409-9635-4dff7e5916a9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:53.196546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 372/762] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:23:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:53.196869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527a54-13b7-4409-9635-4dff7e5916a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:53.202045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:53.238316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ae527a54-13b7-4409-9635-4dff7e5916a9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:53.239832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ae527a54-13b7-4409-9635-4dff7e5916a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:53.311116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 391/763] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:23:53.357494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae527a54-13b7-4409-9635-4dff7e5916a9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:53.388298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c73d5-a062-43c9-8a7b-cd42e7a8a986 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:53.432690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:53.459260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:53.460058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:53.460333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:53.460601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:53.472638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:53.480258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:53.481733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:53.509860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:53.510855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:53.512183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:53.512183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:53.512183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:53.512183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:53.512183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 373/764] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:53.517089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:53.520092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae527a54-13b7-4409-9635-4dff7e5916a9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:53.586081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37372952-3d87-4750-981a-1153afd75270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:53.586891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372952-3d87-4750-981a-1153afd75270 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:53.587170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372952-3d87-4750-981a-1153afd75270 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:53.587438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37372952-3d87-4750-981a-1153afd75270 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:53.588093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37372952-3d87-4750-981a-1153afd75270 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:53.589506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37372952-3d87-4750-981a-1153afd75270 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-37372952-3d87-4750-981a-1153afd75270 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:53.610824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:53.611786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:53.612639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:53.613633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 392/765] 10.222.0.70 () {56 vars in 1129 bytes} [Wed May 18 22:23:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:53.620410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37372952-3d87-4750-981a-1153afd75270 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:53.645170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eefb7c-5713-4347-9376-6e5cac7007b3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:53.683001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:53.683583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:53.683863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:53.684132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:53.684851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:53.685153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:53.686662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:53.699433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 374/766] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:53.708023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:53.780039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37372952-3d87-4750-981a-1153afd75270 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:53.787588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:53.807899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:53.838230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:53.838920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:53.839199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:53.839560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:53.840288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:53.840588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:53.842041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:53.858461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 393/767] 10.222.0.70 () {56 vars in 1124 bytes} [Wed May 18 22:23:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:53.860497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:53.911925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33985a-a6e4-42d1-a584-04c449780c4b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:53.984144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:53.984933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:53.985210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:53.985477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:53.991195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7343fd-89b8-421e-be4b-620e62987b43 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:53.997950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:53.999418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:54.021050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:54.022036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:54.027477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 375/768] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:54.028382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:54.052677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:54.053692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.054198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.054982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.056081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:54.056588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:54.058183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:54.069227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 394/769] 10.222.0.70 () {56 vars in 1124 bytes} [Wed May 18 22:23:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:54.075151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:54.118789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:54.174299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e4b3f-428a-4a7b-947c-d8c0e9476db3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:54.184729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:54.202072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dabc-a000-4383-915b-2cbd542751c3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:54.223114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc148e2-fe4c-4446-a9fd-c3cf0a5307ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:54.224652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc148e2-fe4c-4446-a9fd-c3cf0a5307ed None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.225349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc148e2-fe4c-4446-a9fd-c3cf0a5307ed None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.225766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc148e2-fe4c-4446-a9fd-c3cf0a5307ed None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.227079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc148e2-fe4c-4446-a9fd-c3cf0a5307ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:54.227937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc148e2-fe4c-4446-a9fd-c3cf0a5307ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:54.229829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc148e2-fe4c-4446-a9fd-c3cf0a5307ed None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:54.239058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa6be4-bc7d-48d2-8351-763183453322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:54.239811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6be4-bc7d-48d2-8351-763183453322 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.240162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6be4-bc7d-48d2-8351-763183453322 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.240507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa6be4-bc7d-48d2-8351-763183453322 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.241625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6be4-bc7d-48d2-8351-763183453322 None admin] RBAC: Adding query filter params (interface=public, service_id=939ffb8d421245089877490fd2770cbd, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:54.241746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6be4-bc7d-48d2-8351-763183453322 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:54.243880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa6be4-bc7d-48d2-8351-763183453322 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:54.246121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 376/770] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:54.247727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08897-e910-4d18-b4ce-86b9bbdbe583 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.248201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08897-e910-4d18-b4ce-86b9bbdbe583 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.248650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08897-e910-4d18-b4ce-86b9bbdbe583 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.251557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 377/771] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:54.252420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d08897-e910-4d18-b4ce-86b9bbdbe583 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:54.257094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 395/772] 10.222.0.70 () {56 vars in 1251 bytes} [Wed May 18 22:23:54 2022] GET /identity/v3/endpoints?service_id=939ffb8d421245089877490fd2770cbd&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:54.258872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e033-7e10-40ca-9621-4fd6d92b11e0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.259299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e033-7e10-40ca-9621-4fd6d92b11e0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.259650 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8e033-7e10-40ca-9621-4fd6d92b11e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.277448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-33a8e033-7e10-40ca-9621-4fd6d92b11e0 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:54.278778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-33a8e033-7e10-40ca-9621-4fd6d92b11e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:54.357586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 396/773] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:23:54.358573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8e033-7e10-40ca-9621-4fd6d92b11e0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:54.389143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d08897-e910-4d18-b4ce-86b9bbdbe583 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:54.396631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:54.426375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097eff5-a74e-4c48-8d3b-bcd4e850abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:54.427147 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097eff5-a74e-4c48-8d3b-bcd4e850abc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.427420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097eff5-a74e-4c48-8d3b-bcd4e850abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.427691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097eff5-a74e-4c48-8d3b-bcd4e850abc3 None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/55b3fcbfb08544d482bd0bea4b3d3f0f/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.430090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097eff5-a74e-4c48-8d3b-bcd4e850abc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=55b3fcbfb08544d482bd0bea4b3d3f0f, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:54.431617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097eff5-a74e-4c48-8d3b-bcd4e850abc3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:54.483988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8e033-7e10-40ca-9621-4fd6d92b11e0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:54.484722 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 378/774] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:23:54 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/55b3fcbfb08544d482bd0bea4b3d3f0f/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:54.490757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097eff5-a74e-4c48-8d3b-bcd4e850abc3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:54.550133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:54.565598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1845cfa-2e8e-4b75-b5f1-11eac56827de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:54.566759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1845cfa-2e8e-4b75-b5f1-11eac56827de None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.567217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1845cfa-2e8e-4b75-b5f1-11eac56827de None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.568089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1845cfa-2e8e-4b75-b5f1-11eac56827de None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.568981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1845cfa-2e8e-4b75-b5f1-11eac56827de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:54.573097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1845cfa-2e8e-4b75-b5f1-11eac56827de None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:54.585766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 397/775] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:23:54 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:54.671943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097eff5-a74e-4c48-8d3b-bcd4e850abc3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:54.731540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d057e-f3d8-4a8e-a4e3-93310e755cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:54.732640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d057e-f3d8-4a8e-a4e3-93310e755cbe None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.733098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d057e-f3d8-4a8e-a4e3-93310e755cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.733556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d057e-f3d8-4a8e-a4e3-93310e755cbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.749290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d057e-f3d8-4a8e-a4e3-93310e755cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-833d057e-f3d8-4a8e-a4e3-93310e755cbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:54.757905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:54.758972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:54.760146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 379/776] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:54.765338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1845cfa-2e8e-4b75-b5f1-11eac56827de None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:54.910273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:54.919915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1845cfa-2e8e-4b75-b5f1-11eac56827de None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:54.959431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaf8b3-d25e-4c32-9181-d92c5012f95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:54.960108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaf8b3-d25e-4c32-9181-d92c5012f95b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.960386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaf8b3-d25e-4c32-9181-d92c5012f95b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.961223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaf8b3-d25e-4c32-9181-d92c5012f95b None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.961976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaf8b3-d25e-4c32-9181-d92c5012f95b None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:54.962305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaf8b3-d25e-4c32-9181-d92c5012f95b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:54.963668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaf8b3-d25e-4c32-9181-d92c5012f95b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:54.974229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543e60-2270-44be-b0a3-0ba16153c077 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.974551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543e60-2270-44be-b0a3-0ba16153c077 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.974775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6543e60-2270-44be-b0a3-0ba16153c077 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:54.976103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 380/777] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:54.977065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 398/778] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:54.978562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6543e60-2270-44be-b0a3-0ba16153c077 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:54.983125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c76334-db47-4c0a-9c1e-580dcf9cf549 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:54.983346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c76334-db47-4c0a-9c1e-580dcf9cf549 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:54.983618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c76334-db47-4c0a-9c1e-580dcf9cf549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.002417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c5c76334-db47-4c0a-9c1e-580dcf9cf549 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:55.003936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c5c76334-db47-4c0a-9c1e-580dcf9cf549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:55.116468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 399/779] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:23:55.130849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:55.151706 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6543e60-2270-44be-b0a3-0ba16153c077 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:55.155073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c76334-db47-4c0a-9c1e-580dcf9cf549 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:55.216026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:55.217446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.217781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.218087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.247235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:55.248626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:55.271175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:55.283710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c76334-db47-4c0a-9c1e-580dcf9cf549 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:55.294869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:55.295891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:55.297601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:55.297601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:55.297601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:55.297601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:55.297601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 381/780] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:55.301784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:55.349311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:55.350136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.350422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.350693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] PATH_INFO: `/v3/services/network` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.352023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:55.353306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:55.372484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:55.374382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:55.375475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 400/781] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:55 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:55.379761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:55.486854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327150ae-4802-40fe-b785-77ef40e0e67f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:55.551958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4399da-8ed7-471a-bef7-e404b006604d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:55.552902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:55.553869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.554503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.555047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.555963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:55.556496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:55.566022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:55.574423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:55.586943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 382/782] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:55.591008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:55.594097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.594097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.594097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.594097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] RBAC: Adding query filter params (name=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:55.594097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:55.595355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:55.596152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:55.600808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 401/783] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:23:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:55.606875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:55.623044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:55.709288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a5b89-cb7a-47b8-84db-465c6e2e4f22 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:55.709830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938cca25-61b3-49bc-a072-b72fac399bbb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:55.745479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a065b1e-95c1-465a-b21f-63359f4375cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:55.745680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20232920-0fbf-40ab-b90c-95b3c961fe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:55.746187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232920-0fbf-40ab-b90c-95b3c961fe97 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.746313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a065b1e-95c1-465a-b21f-63359f4375cf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.746474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232920-0fbf-40ab-b90c-95b3c961fe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.746565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a065b1e-95c1-465a-b21f-63359f4375cf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.746742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20232920-0fbf-40ab-b90c-95b3c961fe97 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.746839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a065b1e-95c1-465a-b21f-63359f4375cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.747632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20232920-0fbf-40ab-b90c-95b3c961fe97 None admin] RBAC: Adding query filter params (type=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:55.748034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20232920-0fbf-40ab-b90c-95b3c961fe97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:55.749530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20232920-0fbf-40ab-b90c-95b3c961fe97 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:55.755077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a065b1e-95c1-465a-b21f-63359f4375cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:55.756517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a065b1e-95c1-465a-b21f-63359f4375cf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:55.758094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 402/784] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:23:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:55.759490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c302-5ba0-452b-8582-873788e9259c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.759775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c302-5ba0-452b-8582-873788e9259c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.760046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62c302-5ba0-452b-8582-873788e9259c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.761571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 403/785] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:55.765895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62c302-5ba0-452b-8582-873788e9259c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0a065b1e-95c1-465a-b21f-63359f4375cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:55.778885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:55.779858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:55.781244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 383/786] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:23:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:55.782573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca24952-1fd0-45fd-9a00-3f7b5bd75c0e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.782573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca24952-1fd0-45fd-9a00-3f7b5bd75c0e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.782573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca24952-1fd0-45fd-9a00-3f7b5bd75c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.802120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-dca24952-1fd0-45fd-9a00-3f7b5bd75c0e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:55.803420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-dca24952-1fd0-45fd-9a00-3f7b5bd75c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:55.862551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:55.875365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:55.885789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 384/787] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:23:55.885789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca24952-1fd0-45fd-9a00-3f7b5bd75c0e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:55.929089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62c302-5ba0-452b-8582-873788e9259c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:55.965962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:55.966949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:55.967426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:55.967868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:55.968888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] RBAC: Adding query filter params (interface=public, service_id=549fec88168a4ba394fc1686ea21ead4, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:55.969371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:55.970944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:55.977673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 404/788] 10.222.0.70 () {56 vars in 1251 bytes} [Wed May 18 22:23:55 2022] GET /identity/v3/endpoints?service_id=549fec88168a4ba394fc1686ea21ead4&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:55.978732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.018832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca24952-1fd0-45fd-9a00-3f7b5bd75c0e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.066404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:56.067371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:56.068085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:56.068528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:56.069526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:56.070576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:56.072378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:56.097036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 385/789] 10.222.0.70 () {56 vars in 1149 bytes} [Wed May 18 22:23:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:56.098456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.118075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd4c1f-bc8d-4d07-b283-8b66323a0146 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.154137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:56.155863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26e18-f1ed-4e71-9368-de8962ac0b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:56.156881 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26e18-f1ed-4e71-9368-de8962ac0b32 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:56.157334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26e18-f1ed-4e71-9368-de8962ac0b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:56.157806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26e18-f1ed-4e71-9368-de8962ac0b32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:56.166354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:56.170383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26e18-f1ed-4e71-9368-de8962ac0b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1be26e18-f1ed-4e71-9368-de8962ac0b32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:56.178346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:56.179257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:56.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:56.183069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 405/790] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:56.184024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26e18-f1ed-4e71-9368-de8962ac0b32 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.220875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da2ba-68df-4126-991c-c3f2e0087290 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.267432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48b6a5-142b-4160-a1cd-069475cb0aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:56.269016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48b6a5-142b-4160-a1cd-069475cb0aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:56.269820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48b6a5-142b-4160-a1cd-069475cb0aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:56.270315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48b6a5-142b-4160-a1cd-069475cb0aa0 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:56.271437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48b6a5-142b-4160-a1cd-069475cb0aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:56.274254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48b6a5-142b-4160-a1cd-069475cb0aa0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:56.286031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 386/791] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:23:56 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:56.286031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48b6a5-142b-4160-a1cd-069475cb0aa0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.378104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26e18-f1ed-4e71-9368-de8962ac0b32 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.418294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48b6a5-142b-4160-a1cd-069475cb0aa0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.431016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:56.433894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:56.434948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:56.435463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:56.435931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:56.447923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:56.449740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:56.457350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:56.458054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:56.458345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:56.458624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:56.459376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:56.459684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:56.462477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:56.471290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:56.472276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:56.473182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:56.473182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:56.473182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:56.473182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:56.473411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 387/792] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:56.475467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 406/793] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:56.482603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.483942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.586390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:56.594645 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a3393-5d82-402d-b96b-ac2a92953d46 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.619254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3439a4-2842-4034-8117-84df1db8d635 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.634984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:56.635856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:56.636146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:56.636418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:56.650782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:56.652747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:56.657361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:56.658080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:56.658370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:56.658640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:56.659357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:56.659658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:56.661069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:56.676610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:56.677556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:56.678524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:56.678524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:56.678524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:56.678524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:56.680777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 407/795] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:56.680914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 388/795] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:56.684345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.690248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.738278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:56.846610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0546c41-0dc4-41ff-86ed-b754996af1a0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.883077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:56.884085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:56.884456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:56.884821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:56.892004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:56.893615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:56.908432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:56.909549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:56.910698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:56.910698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:56.910698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:56.910698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:56.910698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:56.910698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:56.910698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:56.910698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:56.914250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 389/796] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:56.918572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:56.924674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624036-727a-46b0-989c-8f364bb949b4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:56.960174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:57.006493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:57.007203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.007510 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.007810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.008534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:57.008834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:57.010214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:57.033509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 408/797] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:57.037298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:57.102374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:57.121444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1438b-40dc-4394-93d1-a8fa733b06bd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:57.178956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5ae2c-0f30-4b45-99cb-3b4247fd0ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:57.180378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ae2c-0f30-4b45-99cb-3b4247fd0ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.180780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ae2c-0f30-4b45-99cb-3b4247fd0ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.181065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5ae2c-0f30-4b45-99cb-3b4247fd0ac5 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.181972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5ae2c-0f30-4b45-99cb-3b4247fd0ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:57.182323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5ae2c-0f30-4b45-99cb-3b4247fd0ac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:57.183880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5ae2c-0f30-4b45-99cb-3b4247fd0ac5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:57.202198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 390/798] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:57.203802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e06a7-7fc0-4727-9d50-350ffe77f510 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.204091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e06a7-7fc0-4727-9d50-350ffe77f510 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.204364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e06a7-7fc0-4727-9d50-350ffe77f510 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.209891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 391/799] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:57.209891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e06a7-7fc0-4727-9d50-350ffe77f510 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:57.211463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb6561-8310-466e-9e6a-39639b43e2c9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:57.251062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250cd0c-7956-45cf-8bfb-acf72733732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:57.252250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250cd0c-7956-45cf-8bfb-acf72733732d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.252732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250cd0c-7956-45cf-8bfb-acf72733732d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.253204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250cd0c-7956-45cf-8bfb-acf72733732d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.264540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250cd0c-7956-45cf-8bfb-acf72733732d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:57.267058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250cd0c-7956-45cf-8bfb-acf72733732d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c250cd0c-7956-45cf-8bfb-acf72733732d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:57.286423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:57.287434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 22:23:57.288403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:57.292320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 409/800] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:57.293745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca14e8-03c8-446e-8ae1-d438ea11307a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.294272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca14e8-03c8-446e-8ae1-d438ea11307a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.294781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca14e8-03c8-446e-8ae1-d438ea11307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.317979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9eca14e8-03c8-446e-8ae1-d438ea11307a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:57.320162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9eca14e8-03c8-446e-8ae1-d438ea11307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:57.325800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e06a7-7fc0-4727-9d50-350ffe77f510 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:57.355756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:57.369873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aa78d-bf67-4802-baad-13f64e35d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:57.371013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa78d-bf67-4802-baad-13f64e35d887 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.374337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa78d-bf67-4802-baad-13f64e35d887 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.374337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa78d-bf67-4802-baad-13f64e35d887 None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/39cd155a775f496ea9dd309eb3c47af2/roles/5959b7a9b03c486fb50a3eafef4d3baf` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.387483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aa78d-bf67-4802-baad-13f64e35d887 None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=39cd155a775f496ea9dd309eb3c47af2, role_id=5959b7a9b03c486fb50a3eafef4d3baf)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:57.388942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aa78d-bf67-4802-baad-13f64e35d887 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:57.391572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:57.398883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 410/801] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:23:57.399727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca14e8-03c8-446e-8ae1-d438ea11307a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:57.458123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 392/802] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:23:57 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/39cd155a775f496ea9dd309eb3c47af2/roles/5959b7a9b03c486fb50a3eafef4d3baf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:23:57.458123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810904e9-9ab4-40d2-ae9e-7640f4b26b7e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.458123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810904e9-9ab4-40d2-ae9e-7640f4b26b7e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.458123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810904e9-9ab4-40d2-ae9e-7640f4b26b7e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.458123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 393/803] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:57.458123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810904e9-9ab4-40d2-ae9e-7640f4b26b7e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:57.538632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca14e8-03c8-446e-8ae1-d438ea11307a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:57.590680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa878cc-1b69-49c3-98a2-57d29ef40a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:57.592100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa878cc-1b69-49c3-98a2-57d29ef40a3f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.592460 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa878cc-1b69-49c3-98a2-57d29ef40a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.592814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa878cc-1b69-49c3-98a2-57d29ef40a3f None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.593995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa878cc-1b69-49c3-98a2-57d29ef40a3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:57.594331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa878cc-1b69-49c3-98a2-57d29ef40a3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:57.596946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa878cc-1b69-49c3-98a2-57d29ef40a3f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:57.607845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810904e9-9ab4-40d2-ae9e-7640f4b26b7e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:57.623839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 411/804] 10.222.0.70 () {56 vars in 1135 bytes} [Wed May 18 22:23:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:57.625290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf128-bbd6-4d4c-914b-976e98d187d5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.625678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf128-bbd6-4d4c-914b-976e98d187d5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.625955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cf128-bbd6-4d4c-914b-976e98d187d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.647029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c44cf128-bbd6-4d4c-914b-976e98d187d5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:57.649937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c44cf128-bbd6-4d4c-914b-976e98d187d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:57.653787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e32c-5f21-4286-ae2c-af708fb796fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:57.656256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e32c-5f21-4286-ae2c-af708fb796fd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.656256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e32c-5f21-4286-ae2c-af708fb796fd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.656256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e32c-5f21-4286-ae2c-af708fb796fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.671318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94e32c-5f21-4286-ae2c-af708fb796fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:23:57.672455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-aa94e32c-5f21-4286-ae2c-af708fb796fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:23:57.679228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:57.680956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:57.681837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 394/805] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:57.686530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e32c-5f21-4286-ae2c-af708fb796fd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:57.747566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 412/806] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:23:57.754027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cf128-bbd6-4d4c-914b-976e98d187d5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:57.766627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:57.823618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e32c-5f21-4286-ae2c-af708fb796fd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:57.863227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:57.864796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.865535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.865988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.884328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:57.886781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:57.888007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cf128-bbd6-4d4c-914b-976e98d187d5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:57.910043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:57.911201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:57.912335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:57.912335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:57.912335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:57.912335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:57.917462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 395/807] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:57.917462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:57.931748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:57.932803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:57.933280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:57.933788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:57.934774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:57.935297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:57.936842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:57.946919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 413/808] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:57.948225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:57.964311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:58.042819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7ccf3-16f2-472e-8bef-59aeb85c354d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.051243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:58.063550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abde45b-b166-428c-b489-e686b5a14253 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.081108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.082188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.082945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.082945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.083868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.085340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.103185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:58.103387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:58.104287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:58.105162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 396/809] 10.222.0.70 () {56 vars in 1129 bytes} [Wed May 18 22:23:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:58.106146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.112954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.113475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.113950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.114919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:58.115457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.117167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.130761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 414/810] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:58.131842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.219758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b0951-244f-4fe6-9ae8-650dcdd1b3ad None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.229296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:58.256738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.258519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.259007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.259501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.266940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690bd4c-27a5-406a-9053-0f9e5560843d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.272567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.275144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:58.294832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:58.295799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:58.296711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:58.296711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:58.296711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:58.296711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:58.299171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 397/811] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:58.300276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.306197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.306862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.307140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.307410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.308122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:58.308425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.309782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.315857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 415/812] 10.222.0.70 () {56 vars in 1124 bytes} [Wed May 18 22:23:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:58.316925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.329665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:58.415030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72625a-08b0-442e-b9a7-2b7967c53c4b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.448455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb737e7a-e24c-4451-ba47-9a5f617bd9d6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.452319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.453419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.453899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.454423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.461699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.463488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:23:58.478924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:58.480049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:58.481171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:23:58.481171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:23:58.481171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:23:58.481171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:23:58.481171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:23:58.481171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:23:58.481171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:23:58.481171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:58.483712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 398/813] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:58.484733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.495768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.496731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.497212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.497708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.498691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:58.499213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.500950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.504370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:58.515500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 416/814] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:58.516647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.597787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:58.621091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7cffc-3357-44e3-ae0e-478e07323bb4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.633466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857247a-048c-429b-9bd3-96e852071195 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.661782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.662938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.663456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.664037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.664995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:58.665514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.667309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.673540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 399/815] 10.222.0.70 () {56 vars in 1124 bytes} [Wed May 18 22:23:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:58.674750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.683709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.684398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.684674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.684941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.685744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:58.686072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.687600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.706324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 417/816] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:23:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:58.707783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.774261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:58.793091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076f572-a571-4af5-9f4b-9ba4dccf4864 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.831486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.832347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.832584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.832858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.838448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2772c8-28aa-4458-b3a9-5a669184d2c9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.841833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.842822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:23:58.858944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:58.859918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:58.860890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 400/817] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:23:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:58.861495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:58.871625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:58.882410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98865ab8-7272-4ef5-8a8d-5d806992b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:58.883095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865ab8-7272-4ef5-8a8d-5d806992b50d None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:58.883378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865ab8-7272-4ef5-8a8d-5d806992b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:58.883653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98865ab8-7272-4ef5-8a8d-5d806992b50d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:58.884390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98865ab8-7272-4ef5-8a8d-5d806992b50d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:58.885740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98865ab8-7272-4ef5-8a8d-5d806992b50d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:58.963106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463bd7b-ed8e-4d2e-9420-20e8b6c3ab81 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:58.990552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 418/818] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:23:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:23:58.993231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb965a-6aa8-46fb-bed8-366b714ff5a8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.000006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb965a-6aa8-46fb-bed8-366b714ff5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.000930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb965a-6aa8-46fb-bed8-366b714ff5a8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.002861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 419/819] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:23:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:23:59.003869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb965a-6aa8-46fb-bed8-366b714ff5a8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:59.014309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9a60a-40ae-428b-ae2a-0bba3fe18867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:59.018718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9a60a-40ae-428b-ae2a-0bba3fe18867 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.018718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9a60a-40ae-428b-ae2a-0bba3fe18867 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.018718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9a60a-40ae-428b-ae2a-0bba3fe18867 None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/c90d79a9665b4d9f8dc1ea440882a65c/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.019233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9a60a-40ae-428b-ae2a-0bba3fe18867 None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=c90d79a9665b4d9f8dc1ea440882a65c, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:59.020996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9a60a-40ae-428b-ae2a-0bba3fe18867 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:59.132925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb965a-6aa8-46fb-bed8-366b714ff5a8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:59.154586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 401/820] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:23:58 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/c90d79a9665b4d9f8dc1ea440882a65c/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:23:59.156295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:59.158403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9ba18-fd76-4b33-b2f5-101295215853 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.158851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9ba18-fd76-4b33-b2f5-101295215853 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.159520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9ba18-fd76-4b33-b2f5-101295215853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.186537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:59.187216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.187612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.187784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.188822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:59.188931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:59.191533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:59.196189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-03a9ba18-fd76-4b33-b2f5-101295215853 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:23:59.197456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-03a9ba18-fd76-4b33-b2f5-101295215853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:23:59.212926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 420/821] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:23:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:23:59.218482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:59.305917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:59.318270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 402/822] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:23:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:23:59.345426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9ba18-fd76-4b33-b2f5-101295215853 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:59.365392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e89d5-9b1a-492f-a51f-b3f99c82795a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:59.412168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2145d06-84ae-438a-9e7a-4260e41e70ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:59.413527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145d06-84ae-438a-9e7a-4260e41e70ea None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.414214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145d06-84ae-438a-9e7a-4260e41e70ea None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.414809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2145d06-84ae-438a-9e7a-4260e41e70ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.478321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:59.485191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9ba18-fd76-4b33-b2f5-101295215853 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:59.513366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2145d06-84ae-438a-9e7a-4260e41e70ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:59.514930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2145d06-84ae-438a-9e7a-4260e41e70ea None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:59.531873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:59.532758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.533105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.533446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] PATH_INFO: `/v3/services/network` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.534306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:59.535762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:59.549212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:59.550318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:23:59.551493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 403/823] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:23:59 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:23:59.557499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:59.619815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:59.655975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 421/824] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:23:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:23:59.663172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2145d06-84ae-438a-9e7a-4260e41e70ea None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:59.678050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c22e7-8fe1-4a09-84ab-393c5c032b72 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:59.710571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:59.711382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.711707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.712058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.712849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:59.713207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:59.714732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:59.720016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 404/825] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:23:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:59.725418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:59.775987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:59.807648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2145d06-84ae-438a-9e7a-4260e41e70ea None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:59.836978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e323c6a-f573-45e2-87c6-1e7e391c26f3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:23:59.844056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:59.845085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.845581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.846059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.857502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:59.859204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:59.859732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:23:59.875641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:23:59.876302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:23:59.876580 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:23:59.876854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:23:59.877618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] RBAC: Adding query filter params (type=network) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:23:59.877970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:23:59.879370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:23:59.880797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:23:59.881699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:23:59.883811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:23:59.883811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:23:59.883811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:23:59.883811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:23:59.885586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 405/826] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:23:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:23:59.886058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 422/827] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:23:59.891869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:23:59.893060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:00.008233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a632e-7f5e-40a2-a3aa-89ee3bc45e72 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:00.031386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed1bbb-6cd7-4c65-a44a-6652a3ebbc84 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:00.048030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:00.065050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863c271-ed6e-412a-87d6-56543ffb99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:00.065787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863c271-ed6e-412a-87d6-56543ffb99a6 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.066333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863c271-ed6e-412a-87d6-56543ffb99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.066746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863c271-ed6e-412a-87d6-56543ffb99a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.068062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863c271-ed6e-412a-87d6-56543ffb99a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:00.070279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863c271-ed6e-412a-87d6-56543ffb99a6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:00.077506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4050ad-0adf-4347-a4c4-aba815810c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:00.078355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4050ad-0adf-4347-a4c4-aba815810c1a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.078738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4050ad-0adf-4347-a4c4-aba815810c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.079093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4050ad-0adf-4347-a4c4-aba815810c1a None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.079914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4050ad-0adf-4347-a4c4-aba815810c1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:00.080322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4050ad-0adf-4347-a4c4-aba815810c1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:00.082090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4050ad-0adf-4347-a4c4-aba815810c1a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:00.096174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 406/828] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:00.097407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b362a3-0af7-4809-b8df-954bdb23e5c8 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.100020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b362a3-0af7-4809-b8df-954bdb23e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.100020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b362a3-0af7-4809-b8df-954bdb23e5c8 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.100020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 407/829] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:00.102880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b362a3-0af7-4809-b8df-954bdb23e5c8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:00.152686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:00.198068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 423/830] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:23:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:00.200012 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb49c-4a0d-48dc-a430-599657aab5aa None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.200462 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb49c-4a0d-48dc-a430-599657aab5aa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.200751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fb49c-4a0d-48dc-a430-599657aab5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.241759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-254fb49c-4a0d-48dc-a430-599657aab5aa None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:00.245686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-254fb49c-4a0d-48dc-a430-599657aab5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:00.259216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b362a3-0af7-4809-b8df-954bdb23e5c8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:00.331293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:00.333387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.333819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.334281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.352569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:00.353722 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:00.387358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:00.388446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:00.389359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 408/831] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:00.392908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 424/832] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:00.395367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:00.419367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb49c-4a0d-48dc-a430-599657aab5aa None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:00.542595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:00.547271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb77c1-bca4-4382-b81d-f3a752baa197 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:00.555717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fb49c-4a0d-48dc-a430-599657aab5aa None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:00.566133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:00.597439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:00.598123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.598392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.598664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.599433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:00.599741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:00.601199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:00.604974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865be2e-c543-4f67-ac9b-7b136520ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:00.606076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865be2e-c543-4f67-ac9b-7b136520ceac None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.606563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865be2e-c543-4f67-ac9b-7b136520ceac None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.607036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865be2e-c543-4f67-ac9b-7b136520ceac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.618869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 409/833] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:00.625747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:00.626171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865be2e-c543-4f67-ac9b-7b136520ceac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d865be2e-c543-4f67-ac9b-7b136520ceac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:00.635098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:00.636073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:24:00.636921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:00.642080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 425/834] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:24:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:00.643154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865be2e-c543-4f67-ac9b-7b136520ceac None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:00.767260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865be2e-c543-4f67-ac9b-7b136520ceac None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:00.778453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe174-c47c-4681-adce-a849b3d0e175 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:00.814982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:00.815632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:00.816184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.816438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:00.816787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.817009 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:00.817110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.817533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:00.818310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:00.818680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:00.819214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=55b3fcbfb08544d482bd0bea4b3d3f0f) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:00.819690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:00.820915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:00.821911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:00.828633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 410/835] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:00 2022] GET /identity/v3/role_assignments?user.id=55b3fcbfb08544d482bd0bea4b3d3f0f&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=fe643140d2134736a54afd972d47d43f => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:00.835036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 426/836] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:00.837293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:00.886395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:00.959432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646fd61-2c48-4999-b955-eb69fef0be6a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:01.001023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:01.001828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.002132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.002403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.020174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:01.021636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:01.045295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:01.046287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:01.047232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:01.047232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:01.047232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:01.047232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:01.047232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 411/837] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:01.056273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:01.090099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:01.170462 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f929a2-e2a4-4dde-bd3f-50ad5de159fb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:01.205384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:01.206076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.206360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.206633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.207359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:01.207662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:01.209019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:01.221501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 427/838] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:01.231060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:01.311416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:01.334908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090b45-ff11-4aa2-a0e9-f0e54ca5cb92 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:01.372855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57300520-4ebc-4421-9c6e-1b8181cebc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:01.373607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57300520-4ebc-4421-9c6e-1b8181cebc35 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.373885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57300520-4ebc-4421-9c6e-1b8181cebc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.374194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57300520-4ebc-4421-9c6e-1b8181cebc35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.383578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57300520-4ebc-4421-9c6e-1b8181cebc35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:01.385064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57300520-4ebc-4421-9c6e-1b8181cebc35 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-57300520-4ebc-4421-9c6e-1b8181cebc35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:01.401475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:01.402546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:01.403521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 412/839] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:24:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:01.408466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:01.505953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:01.516475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e5f4-dc73-48d8-865d-23052ed0217b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:01.552894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:01.553554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.553831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.554129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.555622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:01.555925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:01.557349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:01.564875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceb962-8b02-41a8-8f9a-15a59e74d357 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.565430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceb962-8b02-41a8-8f9a-15a59e74d357 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.565921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceb962-8b02-41a8-8f9a-15a59e74d357 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.568051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 413/840] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:01.573979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b0890-98b5-43db-8bd8-071cbcb625b8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.574648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b0890-98b5-43db-8bd8-071cbcb625b8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.575111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b0890-98b5-43db-8bd8-071cbcb625b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.576842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 428/841] 10.222.0.70 () {56 vars in 1149 bytes} [Wed May 18 22:24:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:01.582996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:01.594804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c95b0890-98b5-43db-8bd8-071cbcb625b8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:01.596386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c95b0890-98b5-43db-8bd8-071cbcb625b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:01.689495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 414/842] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:01.712016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b0890-98b5-43db-8bd8-071cbcb625b8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:01.719323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a6eb6-c4c8-482d-a100-c3615b7c58c3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:01.762802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6cb88-866f-439b-bc05-67517e400675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:01.763453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6cb88-866f-439b-bc05-67517e400675 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.763732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6cb88-866f-439b-bc05-67517e400675 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.764004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6cb88-866f-439b-bc05-67517e400675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.787559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:01.798901 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:01.845889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b0890-98b5-43db-8bd8-071cbcb625b8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:01.852488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6cb88-866f-439b-bc05-67517e400675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:01.853943 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6cb88-866f-439b-bc05-67517e400675 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:01.891536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548c2a5-c4f8-46cb-96fb-5f11d18e5988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:01.892324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c2a5-c4f8-46cb-96fb-5f11d18e5988 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.892600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c2a5-c4f8-46cb-96fb-5f11d18e5988 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.893086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548c2a5-c4f8-46cb-96fb-5f11d18e5988 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.893730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c2a5-c4f8-46cb-96fb-5f11d18e5988 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:01.895126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548c2a5-c4f8-46cb-96fb-5f11d18e5988 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b548c2a5-c4f8-46cb-96fb-5f11d18e5988 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:01.908055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:01.909099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:01.909976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 415/843] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:01.910839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9a05-6caa-4984-8bd5-3288264cb294 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.911751 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9a05-6caa-4984-8bd5-3288264cb294 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.911751 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9a05-6caa-4984-8bd5-3288264cb294 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.916937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 416/844] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:01.916937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de9a05-6caa-4984-8bd5-3288264cb294 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:01.974786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 429/845] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:24:01.976882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f693a-a224-475c-8a44-8255c7d5d4e6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:01.977164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f693a-a224-475c-8a44-8255c7d5d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:01.977543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f693a-a224-475c-8a44-8255c7d5d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:01.994356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-661f693a-a224-475c-8a44-8255c7d5d4e6 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:01.995532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-661f693a-a224-475c-8a44-8255c7d5d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:02.028955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de9a05-6caa-4984-8bd5-3288264cb294 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.043348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:02.063678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:02.069469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.070750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.071465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 430/846] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:02.072739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f693a-a224-475c-8a44-8255c7d5d4e6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.078504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.079057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.080056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:02.080552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.082183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:02.090762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 417/847] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:02.094356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.188430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f693a-a224-475c-8a44-8255c7d5d4e6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.201076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fb283-4f46-41ec-8e44-6b4c029348c1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.225118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.226772 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.227046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.227345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.237899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae30e2f-eae3-4fd2-92f3-8043e6922ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.238222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.238715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30e2f-eae3-4fd2-92f3-8043e6922ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.238991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30e2f-eae3-4fd2-92f3-8043e6922ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.239260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae30e2f-eae3-4fd2-92f3-8043e6922ca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.239649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:02.250240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae30e2f-eae3-4fd2-92f3-8043e6922ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8ae30e2f-eae3-4fd2-92f3-8043e6922ca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:02.257892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:02.259320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:24:02.260202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:02.260872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:02.261734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:02.265649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:02.265649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:02.265649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:02.265649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:02.266288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 418/848] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:02.266445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 431/849] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:02.266445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.266807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae30e2f-eae3-4fd2-92f3-8043e6922ca4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.301758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:02.326239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:02.373834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae30e2f-eae3-4fd2-92f3-8043e6922ca4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.376678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb30235-00e9-482b-be6c-4dfa8ade1283 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.408615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.409492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.409789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.410061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.410769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:02.411141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.412434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:02.412547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.413200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.413593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.414400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.415327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:02.415766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.416969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:02.426861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 419/850] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:02.426861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.439229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 432/851] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:02.440231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.560926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a45f9-2a16-403d-a6c4-5b8b6f6ac7bf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.564375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:02.576728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad3c1b-5163-40d0-977f-c07eb8fd20b4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.581483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:02.600362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.601677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.602251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.602690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.603420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:02.603805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.605281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:02.618605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.618990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 420/852] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:02.619807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.620083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.620484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.625084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.633812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.635303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:02.654948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:02.656104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:02.657230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:02.657230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:02.657230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:02.657230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:02.660974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 433/853] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:02.661885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.737461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981763b-1b52-43af-b26b-0b6469507c65 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.776537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.777376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.777651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.777969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.778405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f3fed-a989-4ea8-9682-493ac3daec84 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.785235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.786712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:02.801524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:02.802499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:02.803424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 421/854] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:02.808882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.826712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.827909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.828412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.829095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.830460 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:02.830972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.832516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:02.850828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 434/855] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:02.857556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:02.858341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:02.864447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:02.942370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaf68-b867-474e-b684-5f17238c5445 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.970537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4a9b2-ff27-4f11-8c51-302d770d9b58 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:02.988952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:02.990203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:02.990669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:02.991541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:02.993085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:02.993632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:02.995826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.010282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:03.011202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.011549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.011889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.013767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 422/856] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:03.020440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:03.026205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:03.027685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:03.045705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:03.046785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 22:24:03.047768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:03.051984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 435/857] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:24:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:03.052957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:03.123813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:03.133503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:03.138727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf10a-968c-4731-bdf4-3db7f5433620 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:03.168557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae8aaf-5e5a-4258-a484-c40b292ffc70 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:03.173375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9fece-33d9-4dc3-a468-6a8a20690dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:03.174206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fece-33d9-4dc3-a468-6a8a20690dab None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.174494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fece-33d9-4dc3-a468-6a8a20690dab None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.174768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9fece-33d9-4dc3-a468-6a8a20690dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.175602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9fece-33d9-4dc3-a468-6a8a20690dab None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=39cd155a775f496ea9dd309eb3c47af2) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:03.175914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9fece-33d9-4dc3-a468-6a8a20690dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:03.177352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9fece-33d9-4dc3-a468-6a8a20690dab None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.190039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 423/858] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:03 2022] GET /identity/v3/role_assignments?user.id=39cd155a775f496ea9dd309eb3c47af2&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:03.215594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:03.216289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.216576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.216855 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.217711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:03.218065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:03.219761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.233559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5747a8-17ce-43cc-b0c0-8357d1c3fe83 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.233873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5747a8-17ce-43cc-b0c0-8357d1c3fe83 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.234137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5747a8-17ce-43cc-b0c0-8357d1c3fe83 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.238167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 424/859] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:03.240376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 436/860] 10.222.0.70 () {56 vars in 1135 bytes} [Wed May 18 22:24:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:03.241475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3599-9b42-474e-9941-d31a1373e795 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.242405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3599-9b42-474e-9941-d31a1373e795 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.242689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef3599-9b42-474e-9941-d31a1373e795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.246650 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:03.261235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e6ef3599-9b42-474e-9941-d31a1373e795 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:03.262471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e6ef3599-9b42-474e-9941-d31a1373e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:03.361549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 425/861] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:03.378394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9437e8-d5f1-414f-b8ef-5fcee8074b3b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:03.384660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef3599-9b42-474e-9941-d31a1373e795 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:03.414737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:03.438700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330646-cb1e-4e33-9744-16a1173972b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:03.439474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330646-cb1e-4e33-9744-16a1173972b0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.439757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330646-cb1e-4e33-9744-16a1173972b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.440028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330646-cb1e-4e33-9744-16a1173972b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.513092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:03.526533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef3599-9b42-474e-9941-d31a1373e795 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:03.532731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9330646-cb1e-4e33-9744-16a1173972b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:03.534812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9330646-cb1e-4e33-9744-16a1173972b0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.576190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:03.577000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.577275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.577544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.578750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:03.580565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:03.597084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:03.598245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:03.599113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:03.602483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 426/862] 10.222.0.70 () {56 vars in 1132 bytes} [Wed May 18 22:24:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:03.606800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:03.666472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 437/863] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 22:24:03.673203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330646-cb1e-4e33-9744-16a1173972b0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:03.703947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:03.728676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3a9c-e32b-45a7-a29a-6d181494bdad None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:03.772697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:03.774877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.775442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.775954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.776862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:03.777370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:03.778994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.784409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 427/864] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:03.790961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:03.798799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330646-cb1e-4e33-9744-16a1173972b0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:03.823816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:03.836313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:03.837439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.838152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.838473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.850749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:03.853138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:03.873907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:03.874869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:03.875802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:03.875802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:03.875802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:03.875802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:03.882308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 438/865] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:03.883867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:03.922225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c96be9-8ede-4b58-970a-393b0aca8a9e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:03.957762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:03.958790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:03.959313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:03.959780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:03.961236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:03.961758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:03.963350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:03.968698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 428/866] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:04.002440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:04.006649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f27187-ff13-499d-8a2b-d3811981c0d5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:04.050036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:04.050816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:04.051155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:04.051429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:04.052213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:04.052520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:04.053922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:04.068307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 439/867] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:04.074633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:04.172904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:04.190815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c45e9-1317-4938-aaca-7ea50614c1d8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:04.232708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:04.233507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:04.233781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:04.234091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:04.240935 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:04.242545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:04.256314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:04.257242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:04.258951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 429/868] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:04.265710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:04.368546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa8d28-9b5f-4cc9-8aa9-a4a5a5313f16 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:04.403907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cefb-3472-4a84-bec7-313a15426097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:04.404932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cefb-3472-4a84-bec7-313a15426097 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:04.405410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cefb-3472-4a84-bec7-313a15426097 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:04.405878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cefb-3472-4a84-bec7-313a15426097 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:04.406882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cefb-3472-4a84-bec7-313a15426097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:04.407434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cefb-3472-4a84-bec7-313a15426097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:04.409114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cefb-3472-4a84-bec7-313a15426097 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:04.412268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:04.423071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 440/869] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:04.429404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:04.553312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf1c3-c375-4f6d-a53f-2fff897f257a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:04.595190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89dedf-8271-4f62-921d-4acb5681c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:04.595853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dedf-8271-4f62-921d-4acb5681c511 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:04.596129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dedf-8271-4f62-921d-4acb5681c511 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:04.596398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dedf-8271-4f62-921d-4acb5681c511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:04.597241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89dedf-8271-4f62-921d-4acb5681c511 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=c90d79a9665b4d9f8dc1ea440882a65c) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:04.597546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89dedf-8271-4f62-921d-4acb5681c511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:04.599069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89dedf-8271-4f62-921d-4acb5681c511 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:04.607291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 430/870] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:04 2022] GET /identity/v3/role_assignments?user.id=c90d79a9665b4d9f8dc1ea440882a65c&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=fe643140d2134736a54afd972d47d43f => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:04.771864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135ba45-1150-43ac-a414-074fa6a4fe60 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:04.772393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135ba45-1150-43ac-a414-074fa6a4fe60 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:04.772393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135ba45-1150-43ac-a414-074fa6a4fe60 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:04.774536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 441/871] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:04.780394 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81eb0c-32f7-43bc-8afa-f1300dd2b09a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:04.780689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81eb0c-32f7-43bc-8afa-f1300dd2b09a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:04.780954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81eb0c-32f7-43bc-8afa-f1300dd2b09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:04.799705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3a81eb0c-32f7-43bc-8afa-f1300dd2b09a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:04.800881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3a81eb0c-32f7-43bc-8afa-f1300dd2b09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:04.802908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:04.872211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 431/872] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:04.894807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135ba45-1150-43ac-a414-074fa6a4fe60 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:05.001691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135ba45-1150-43ac-a414-074fa6a4fe60 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:05.037874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574aee4-181e-44de-8c9f-2b564442c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:05.038862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574aee4-181e-44de-8c9f-2b564442c0e7 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:05.039282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574aee4-181e-44de-8c9f-2b564442c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:05.039689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574aee4-181e-44de-8c9f-2b564442c0e7 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:05.040583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574aee4-181e-44de-8c9f-2b564442c0e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:05.042191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574aee4-181e-44de-8c9f-2b564442c0e7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:05.123572 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 442/873] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:24:04 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:05.611419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e93a0-3090-4961-bea6-fb057041da80 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:05.611977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e93a0-3090-4961-bea6-fb057041da80 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:05.611977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e93a0-3090-4961-bea6-fb057041da80 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:05.613598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 432/874] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:05.619372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c978-7ad8-4cc7-b31d-82bf304ed8ef None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:05.619665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c978-7ad8-4cc7-b31d-82bf304ed8ef None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:05.619947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034c978-7ad8-4cc7-b31d-82bf304ed8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:05.637328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b034c978-7ad8-4cc7-b31d-82bf304ed8ef None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:05.638542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b034c978-7ad8-4cc7-b31d-82bf304ed8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:05.695326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:05.719475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 443/875] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:05.743510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e93a0-3090-4961-bea6-fb057041da80 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:05.862275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e93a0-3090-4961-bea6-fb057041da80 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:05.899392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb096d-86e7-4378-bd81-c4a8349f2fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:05.900272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb096d-86e7-4378-bd81-c4a8349f2fcf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:05.900554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb096d-86e7-4378-bd81-c4a8349f2fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:05.900829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb096d-86e7-4378-bd81-c4a8349f2fcf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:05.908164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:05.914655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb096d-86e7-4378-bd81-c4a8349f2fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-85fb096d-86e7-4378-bd81-c4a8349f2fcf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:05.922979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:05.931805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:05.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 433/876] 10.222.0.70 () {56 vars in 1120 bytes} [Wed May 18 22:24:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:05.934305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034c978-7ad8-4cc7-b31d-82bf304ed8ef None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:06.064140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034c978-7ad8-4cc7-b31d-82bf304ed8ef None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:06.100547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:06.101760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:06.102071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:06.102331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:06.103336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:06.103643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:06.104988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:06.113965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 444/877] 10.222.0.70 () {56 vars in 1115 bytes} [Wed May 18 22:24:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:06.119446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb096d-86e7-4378-bd81-c4a8349f2fcf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:06.226206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb096d-86e7-4378-bd81-c4a8349f2fcf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:06.265563 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192005e1-1979-40c8-9ae5-dd19c33fa359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:06.266779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192005e1-1979-40c8-9ae5-dd19c33fa359 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:06.267304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192005e1-1979-40c8-9ae5-dd19c33fa359 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:06.267790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192005e1-1979-40c8-9ae5-dd19c33fa359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:06.280968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192005e1-1979-40c8-9ae5-dd19c33fa359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:06.282783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192005e1-1979-40c8-9ae5-dd19c33fa359 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-192005e1-1979-40c8-9ae5-dd19c33fa359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:06.301178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:06.302190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:06.303127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:06.303127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:06.303127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:06.303127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:06.303127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 434/878] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:06.309263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:06.378434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:06.413272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa3b6-44e5-475a-ab2b-fbc150626d22 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:06.419550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa3b6-44e5-475a-ab2b-fbc150626d22 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:06.419550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fa3b6-44e5-475a-ab2b-fbc150626d22 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:06.419550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 435/879] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:06.419827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e3db-bc46-404d-b1fa-3a9f7d5323c5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:06.420794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906990-23be-48c8-a3f2-59e9ad0740b7 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:06.421148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906990-23be-48c8-a3f2-59e9ad0740b7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:06.421491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906990-23be-48c8-a3f2-59e9ad0740b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:06.441297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-19906990-23be-48c8-a3f2-59e9ad0740b7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:06.443029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-19906990-23be-48c8-a3f2-59e9ad0740b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:06.452085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:06.452913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:06.453269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:06.453616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:06.454553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:06.454864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:06.456337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:06.469746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 445/880] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:06.476410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:06.500657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:06.527931 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 436/881] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:06.556186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19906990-23be-48c8-a3f2-59e9ad0740b7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:06.598602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642b3d4-519e-4e76-b75a-eb1cd3cc394f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:06.600631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:06.636674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:06.637931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:06.638452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:06.638947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:06.647329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:06.650159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:06.665326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19906990-23be-48c8-a3f2-59e9ad0740b7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:06.667688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:06.668668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:24:06.669644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:06.672265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 446/882] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:24:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:06.678221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:06.713546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e49c2-344a-47b9-ab2b-aad50355ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:06.714247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e49c2-344a-47b9-ab2b-aad50355ba97 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:06.714532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e49c2-344a-47b9-ab2b-aad50355ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:06.714810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e49c2-344a-47b9-ab2b-aad50355ba97 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:06.715822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e49c2-344a-47b9-ab2b-aad50355ba97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:06.718032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e49c2-344a-47b9-ab2b-aad50355ba97 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:06.792456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88a681-c974-4d01-8b4f-95706cf4c1e5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:06.806207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 437/883] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:24:06 2022] POST /identity/v3/services => generated 269 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:24:06.849124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6fe10-13cc-4306-852e-b214724cea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:06.850322 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6fe10-13cc-4306-852e-b214724cea1a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:06.850878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6fe10-13cc-4306-852e-b214724cea1a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:06.851403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6fe10-13cc-4306-852e-b214724cea1a None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:06.852815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6fe10-13cc-4306-852e-b214724cea1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:06.853373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6fe10-13cc-4306-852e-b214724cea1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:06.855184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6fe10-13cc-4306-852e-b214724cea1a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:06.876822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 447/884] 10.222.0.70 () {56 vars in 1149 bytes} [Wed May 18 22:24:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:06.883815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e49c2-344a-47b9-ab2b-aad50355ba97 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:06.933710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:07.004982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e49c2-344a-47b9-ab2b-aad50355ba97 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:07.030214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a559-1b29-480f-99f9-3a18f418978e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.031149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a559-1b29-480f-99f9-3a18f418978e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.031664 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a559-1b29-480f-99f9-3a18f418978e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.034325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 448/885] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:07.042048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2592cbe-d24d-4736-ad15-66e2e416541c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.042628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2592cbe-d24d-4736-ad15-66e2e416541c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.042903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2592cbe-d24d-4736-ad15-66e2e416541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.051741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b9b89-c0c3-4f4e-ab2f-120cc2bc5583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:07.052598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b9b89-c0c3-4f4e-ab2f-120cc2bc5583 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.053048 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b9b89-c0c3-4f4e-ab2f-120cc2bc5583 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.053474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b9b89-c0c3-4f4e-ab2f-120cc2bc5583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.064789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e2592cbe-d24d-4736-ad15-66e2e416541c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:07.065982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e2592cbe-d24d-4736-ad15-66e2e416541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:07.081746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:07.143018 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b9b89-c0c3-4f4e-ab2f-120cc2bc5583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:07.144447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b9b89-c0c3-4f4e-ab2f-120cc2bc5583 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:07.163236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 449/886] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:07.184789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2592cbe-d24d-4736-ad15-66e2e416541c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:07.197450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:07.282243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 438/887] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:06 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:24:07.287292 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b9b89-c0c3-4f4e-ab2f-120cc2bc5583 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:07.302986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2592cbe-d24d-4736-ad15-66e2e416541c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:07.342261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:07.343527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.344044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.344518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.345413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:07.347077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:07.360778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:07.361852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:07.363056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:07.370915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 450/888] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:07.372409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:07.387730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:07.415520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b9b89-c0c3-4f4e-ab2f-120cc2bc5583 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:07.457911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80bd37-15a1-4445-ba7d-85fee71a0e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:07.458673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80bd37-15a1-4445-ba7d-85fee71a0e88 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.458954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80bd37-15a1-4445-ba7d-85fee71a0e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.459230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80bd37-15a1-4445-ba7d-85fee71a0e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.469192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:07.471157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80bd37-15a1-4445-ba7d-85fee71a0e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:07.472807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80bd37-15a1-4445-ba7d-85fee71a0e88 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:07.489759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7a907-82b7-4cc8-b5ab-fe89315f5f07 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0f80bd37-15a1-4445-ba7d-85fee71a0e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:07.491421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:07.493082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:07.495398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:07.495398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:07.495398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:07.495398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:07.495398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 439/889] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:07.495398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a935ef-aa0d-43ef-8d51-76a8825f8615 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.495398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a935ef-aa0d-43ef-8d51-76a8825f8615 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.495398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a935ef-aa0d-43ef-8d51-76a8825f8615 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.496790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 440/890] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:07.501351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a935ef-aa0d-43ef-8d51-76a8825f8615 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:07.531976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36cfa0a-1ad2-476e-95d5-812b170cd2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:07.532631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cfa0a-1ad2-476e-95d5-812b170cd2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.532914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cfa0a-1ad2-476e-95d5-812b170cd2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.533335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36cfa0a-1ad2-476e-95d5-812b170cd2a9 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.533903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cfa0a-1ad2-476e-95d5-812b170cd2a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:07.534215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cfa0a-1ad2-476e-95d5-812b170cd2a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:07.535566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36cfa0a-1ad2-476e-95d5-812b170cd2a9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:07.545761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 451/891] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:07.545761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1bad-fd59-4bb8-95f1-83629e8f8849 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.545761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1bad-fd59-4bb8-95f1-83629e8f8849 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.545761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d1bad-fd59-4bb8-95f1-83629e8f8849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.561291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c82d1bad-fd59-4bb8-95f1-83629e8f8849 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:07.562591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c82d1bad-fd59-4bb8-95f1-83629e8f8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:07.609310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a935ef-aa0d-43ef-8d51-76a8825f8615 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:07.638109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 452/892] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:07.638109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d1bad-fd59-4bb8-95f1-83629e8f8849 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:07.640371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:07.657153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:07.658556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.658556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.658907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.659646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:07.659953 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:07.661332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:07.677864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 441/893] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:07.677864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:07.732736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:07.745499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d1bad-fd59-4bb8-95f1-83629e8f8849 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:07.783542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:07.784185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f8547-2fd2-4966-a3e4-0e015e932226 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:07.784306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.784472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.784738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.785480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:07.785785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:07.787192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:07.792284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 453/894] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:07.793067 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:07.842518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:07.844938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.845432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.845922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.846821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:07.848442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:07.866373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:07.867617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:07.868472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:07.876869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 442/895] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:07.878690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:07.892185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:07.935286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc4553-28c5-43d5-b2f2-f84552f2e019 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:07.974526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:07.975694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:07.976243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:07.976727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:07.987904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:07.989600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:08.009102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae3809-e987-4736-8292-ed9c12c57d31 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:08.009325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:08.010468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:08.011505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 454/896] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:08.018237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:08.030644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:08.052434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:08.053481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:08.054150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:08.055924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:08.056838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:08.057359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:08.061690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:08.073356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 443/897] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:08.074874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:08.140685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1e66b-b6e6-4ca0-a9b7-dbb506d3ea90 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:08.174682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:08.185983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:08.186424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203a016-c4c3-40cc-88b8-ca8047c1d1dd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:08.186668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:08.186950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:08.187222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:08.188008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:08.188318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:08.189929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:08.206684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 455/898] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:08.215395 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:08.231925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:08.233020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:08.233553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:08.234048 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:08.234960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:08.235519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:08.237090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:08.247954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 444/899] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:08.249526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:08.297900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:08.343362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6d0b1-b8e4-468a-a626-4900bb6e9aeb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:08.358361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579f71d-319e-4da3-b676-31a234dfe299 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:08.386842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:08.387494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:08.387774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:08.388050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:08.388995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] RBAC: Adding query filter params (role.id=f5bde01204ea4412949dbb02c9e51a32, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=39cd155a775f496ea9dd309eb3c47af2) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:08.389410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:08.390860 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:08.396930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd1ea6-12c0-4b59-84c3-5ede99cfc7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:08.397194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 456/900] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:08 2022] GET /identity/v3/role_assignments?user.id=39cd155a775f496ea9dd309eb3c47af2&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=f5bde01204ea4412949dbb02c9e51a32 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:08.397697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1ea6-12c0-4b59-84c3-5ede99cfc7fa None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:08.398210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1ea6-12c0-4b59-84c3-5ede99cfc7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:08.398507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd1ea6-12c0-4b59-84c3-5ede99cfc7fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:08.399297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1ea6-12c0-4b59-84c3-5ede99cfc7fa None admin] RBAC: Adding query filter params (interface=public, service_id=d9b8d0d8373e4a37a8b3482f293c1552, region_id=RegionOne) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:08.399723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1ea6-12c0-4b59-84c3-5ede99cfc7fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:08.401128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd1ea6-12c0-4b59-84c3-5ede99cfc7fa None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:08.414503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 445/901] 10.222.0.70 () {56 vars in 1251 bytes} [Wed May 18 22:24:08 2022] GET /identity/v3/endpoints?service_id=d9b8d0d8373e4a37a8b3482f293c1552&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:08.416233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:08.475577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:08.536070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec45ce-3047-4ee1-b443-a805e6142ec7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:08.576368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d47f-e1fc-4388-b579-41d654c4c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:08.577327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d47f-e1fc-4388-b579-41d654c4c36a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:08.577760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d47f-e1fc-4388-b579-41d654c4c36a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:08.578228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d47f-e1fc-4388-b579-41d654c4c36a None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:08.579071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9d47f-e1fc-4388-b579-41d654c4c36a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:08.580650 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9d47f-e1fc-4388-b579-41d654c4c36a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:08.587722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 457/902] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:24:08 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:24:09.196710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec30c3-bfd9-4f49-bbc3-8f004d603e65 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:09.197267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec30c3-bfd9-4f49-bbc3-8f004d603e65 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:09.197267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec30c3-bfd9-4f49-bbc3-8f004d603e65 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:09.198906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 446/903] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:09.204287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9dae3-f1a8-46d3-94d7-e2a5b96a1ea8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:09.204738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9dae3-f1a8-46d3-94d7-e2a5b96a1ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:09.204836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9dae3-f1a8-46d3-94d7-e2a5b96a1ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:09.222339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c9f9dae3-f1a8-46d3-94d7-e2a5b96a1ea8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:09.223531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c9f9dae3-f1a8-46d3-94d7-e2a5b96a1ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:09.293179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 458/904] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:09.316430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec30c3-bfd9-4f49-bbc3-8f004d603e65 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:09.420668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec30c3-bfd9-4f49-bbc3-8f004d603e65 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:09.430435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:09.456215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:09.457029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:09.457466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:09.457740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:09.458422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:09.459790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:09.472683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:09.473893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:09.475036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:09.478183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 447/905] 10.222.0.70 () {56 vars in 1132 bytes} [Wed May 18 22:24:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:09.483077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9dae3-f1a8-46d3-94d7-e2a5b96a1ea8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:09.531282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:09.593173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9dae3-f1a8-46d3-94d7-e2a5b96a1ea8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:09.629619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:09.630316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:09.630597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:09.630869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:09.631574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:09.631878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:09.633495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:09.638918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 459/906] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:09.644250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:09.755210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc63a3-cf05-43c0-96f1-973a3fda6879 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:09.791424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:09.792148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:09.792425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:09.792694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:09.793447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:09.793750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:09.795156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:09.804809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 448/907] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:09.807231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:09.914091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0bdc-4458-475b-9ec8-9efe72e95195 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:09.925376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:09.948940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbadd2-a9ac-434a-b1ca-7bbadaf588f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:09.949598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbadd2-a9ac-434a-b1ca-7bbadaf588f4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:09.950636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbadd2-a9ac-434a-b1ca-7bbadaf588f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:09.950636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbadd2-a9ac-434a-b1ca-7bbadaf588f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:09.951053 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbadd2-a9ac-434a-b1ca-7bbadaf588f4 None admin] RBAC: Adding query filter params (interface=public, service_id=e5691d0214fc4587b12bd8ad0be062fa, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:09.951362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbadd2-a9ac-434a-b1ca-7bbadaf588f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:09.952824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbadd2-a9ac-434a-b1ca-7bbadaf588f4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:09.961973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 460/908] 10.222.0.70 () {56 vars in 1251 bytes} [Wed May 18 22:24:09 2022] GET /identity/v3/endpoints?service_id=e5691d0214fc4587b12bd8ad0be062fa&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:09.964661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:10.004660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:10.076552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f73a1-2add-4ec0-a202-8c65095a6668 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:10.113497 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053d4db-3008-4db2-976d-ff8eef458320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:10.114184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d4db-3008-4db2-976d-ff8eef458320 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.114458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d4db-3008-4db2-976d-ff8eef458320 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.114723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053d4db-3008-4db2-976d-ff8eef458320 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.115440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053d4db-3008-4db2-976d-ff8eef458320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:10.116894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053d4db-3008-4db2-976d-ff8eef458320 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:10.126176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 449/909] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:24:09 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:24:10.207937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f9ec-ebb3-4f11-90e4-b8cfdb7468fb None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.208903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f9ec-ebb3-4f11-90e4-b8cfdb7468fb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.209385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f9ec-ebb3-4f11-90e4-b8cfdb7468fb None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.212084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 461/910] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:10.218152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102006a1-de6c-4e49-8a1e-fbef3e546692 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.219099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102006a1-de6c-4e49-8a1e-fbef3e546692 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.219582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102006a1-de6c-4e49-8a1e-fbef3e546692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.237608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-102006a1-de6c-4e49-8a1e-fbef3e546692 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:10.239216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-102006a1-de6c-4e49-8a1e-fbef3e546692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:10.317484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 450/911] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:10.341299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9f9ec-ebb3-4f11-90e4-b8cfdb7468fb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:10.449934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9f9ec-ebb3-4f11-90e4-b8cfdb7468fb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:10.485989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7e870-a7c0-4efa-9540-eb045f3a638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:10.486606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e870-a7c0-4efa-9540-eb045f3a638d None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.486885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e870-a7c0-4efa-9540-eb045f3a638d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.487160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e870-a7c0-4efa-9540-eb045f3a638d None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.487889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7e870-a7c0-4efa-9540-eb045f3a638d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:10.489282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7e870-a7c0-4efa-9540-eb045f3a638d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:10.563198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 462/912] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:24:10 2022] POST /identity/v3/services => generated 241 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:10.702752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55bb2-0a50-48ac-985d-0e0eb1df3d68 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.703147 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55bb2-0a50-48ac-985d-0e0eb1df3d68 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.703344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55bb2-0a50-48ac-985d-0e0eb1df3d68 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.705000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 451/913] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:10.711244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f88e12-0089-42ed-8f2b-42a42090a6f6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.711587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f88e12-0089-42ed-8f2b-42a42090a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.711970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f88e12-0089-42ed-8f2b-42a42090a6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.730596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a0f88e12-0089-42ed-8f2b-42a42090a6f6 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:10.731821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a0f88e12-0089-42ed-8f2b-42a42090a6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:10.762332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:10.815275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 463/914] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:10.838957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55bb2-0a50-48ac-985d-0e0eb1df3d68 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:10.871148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:10.952036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55bb2-0a50-48ac-985d-0e0eb1df3d68 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:10.970762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ec0d-ae88-4800-9840-a2649230fbaf None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.971094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ec0d-ae88-4800-9840-a2649230fbaf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.971384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ec0d-ae88-4800-9840-a2649230fbaf None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.973086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 464/915] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:10.979159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf596cf-22a5-4da2-8b3d-410543fadf0e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.979444 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf596cf-22a5-4da2-8b3d-410543fadf0e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.979724 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf596cf-22a5-4da2-8b3d-410543fadf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.988439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d38418-23b8-458b-872c-031bcbea33fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:10.989243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38418-23b8-458b-872c-031bcbea33fa None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:10.989519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38418-23b8-458b-872c-031bcbea33fa None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:10.989788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d38418-23b8-458b-872c-031bcbea33fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:10.998337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bbf596cf-22a5-4da2-8b3d-410543fadf0e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:10.999631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bbf596cf-22a5-4da2-8b3d-410543fadf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:11.001387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d38418-23b8-458b-872c-031bcbea33fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-71d38418-23b8-458b-872c-031bcbea33fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:11.010230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:11.011221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:11.012097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 452/916] 10.222.0.70 () {56 vars in 1120 bytes} [Wed May 18 22:24:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:11.018453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d38418-23b8-458b-872c-031bcbea33fa None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.090151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 465/917] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:11.113044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf596cf-22a5-4da2-8b3d-410543fadf0e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.131577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:11.144138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d38418-23b8-458b-872c-031bcbea33fa None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.188144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.189209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.189947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.190683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.191577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:11.192171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.194548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:11.205705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 453/918] 10.222.0.70 () {56 vars in 1115 bytes} [Wed May 18 22:24:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:11.211723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.230933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:11.244227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf596cf-22a5-4da2-8b3d-410543fadf0e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.290974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.291694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.291975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.292247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.292897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.294268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:11.310365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:11.311638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 22:24:11.312675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:11.315754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 466/919] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:11.322584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.330808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2b92e-487c-4485-8fc1-980b1fc03bfa None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.369471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.370519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.371019 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.371486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.383770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.385591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:11.405390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:11.406638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:11.407550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:11.407550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:11.407550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:11.407550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:11.414442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 454/920] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:11.415693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.419932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:11.446718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8fccb-543a-4da8-899d-e8187fe4e28a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.494790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.495837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.496323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.496850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.497867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:11.498598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.500172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:11.510212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 467/921] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:11.511423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.531853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:11.539533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7818-10a5-4c32-bac0-0024dd5f81b3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.584174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.584759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.585032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.585297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.587196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:11.587506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.589182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:11.604955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 455/922] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:11.610970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.626376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f64c84-f3f7-40a0-9d01-bb121ec92f2c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.672339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.672989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.673267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.673535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.674257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:11.674558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.675972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:11.681428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:11.687123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 468/923] 10.222.0.70 () {56 vars in 1114 bytes} [Wed May 18 22:24:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:11.695393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.728924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddafff-ae75-4a12-9e77-2e6175ac6be3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.779323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.779728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:11.781088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.781855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.782357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.792219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.794843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:11.799586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0aaf-b467-44ad-81c0-31e3b8c0a2b7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:11.813842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:11.814864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:24:11.815822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:11.818893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 456/924] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:24:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:11.825832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:11.844292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc180f1d-3c30-4374-9080-42c5c46f6899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.844922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc180f1d-3c30-4374-9080-42c5c46f6899 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.845201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc180f1d-3c30-4374-9080-42c5c46f6899 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.845475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc180f1d-3c30-4374-9080-42c5c46f6899 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.846319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc180f1d-3c30-4374-9080-42c5c46f6899 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.847685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc180f1d-3c30-4374-9080-42c5c46f6899 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:11.929036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 469/925] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:24:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:11.933694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbbd9f-4fb6-463e-86c9-41643cc3482c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:11.962370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:11.980255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:11.981062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:11.981343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:11.981611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:11.982538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:11.982833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:11.984269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:12.005750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 457/926] 10.222.0.70 () {56 vars in 1149 bytes} [Wed May 18 22:24:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:12.011130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc180f1d-3c30-4374-9080-42c5c46f6899 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:12.128378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc180f1d-3c30-4374-9080-42c5c46f6899 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:12.164776 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:12.165681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.165921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.166219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.173681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:12.177986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:12.180230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:12.198621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:12.199570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:12.200597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:12.200597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:12.200597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:12.200597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:12.200597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 470/927] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:12.207040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:12.322146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baecd4-1a1c-45ab-8a0c-7a1d1e5e89f0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:12.357700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00188b3-a9fc-4c4a-9683-9d0b7d28cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:12.358382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00188b3-a9fc-4c4a-9683-9d0b7d28cd9f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.358649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00188b3-a9fc-4c4a-9683-9d0b7d28cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.358919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00188b3-a9fc-4c4a-9683-9d0b7d28cd9f None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.359635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00188b3-a9fc-4c4a-9683-9d0b7d28cd9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:12.359936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00188b3-a9fc-4c4a-9683-9d0b7d28cd9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:12.361296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00188b3-a9fc-4c4a-9683-9d0b7d28cd9f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:12.373680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 458/928] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:12.379228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:12.473095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15bf8-ae70-4940-9e68-38abfbaa78b5 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.473422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15bf8-ae70-4940-9e68-38abfbaa78b5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.473672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15bf8-ae70-4940-9e68-38abfbaa78b5 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.475444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 459/929] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:12.482700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88209-12f8-460a-8e8f-ba158aa97f33 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.482700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88209-12f8-460a-8e8f-ba158aa97f33 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.482700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88209-12f8-460a-8e8f-ba158aa97f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.489111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78b553-c976-4b9c-9cd5-f77ad7691323 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:12.503281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-80e88209-12f8-460a-8e8f-ba158aa97f33 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:12.505342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-80e88209-12f8-460a-8e8f-ba158aa97f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:12.531131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:12.531924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.532197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.532468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.542069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:12.544154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:12.545837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:12.561602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:12.562613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:12.563530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:12.563530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:12.563530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:12.563530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:12.563530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:12.563530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:12.563530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:12.563530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:12.563976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 471/930] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:12.570637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:12.598355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 460/931] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:12.614238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88209-12f8-460a-8e8f-ba158aa97f33 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:12.629000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:12.685139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682b7a-91d3-4d9f-9d4b-6b4bf605eec0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:12.722981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88209-12f8-460a-8e8f-ba158aa97f33 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:12.727826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:12.728510 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.728794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.729070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.729878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:12.730214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:12.731670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:12.746049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 472/932] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:12.751348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:12.767470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:12.768278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.768551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.768816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.769468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:12.770930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:12.783868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:12.784925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 22:24:12.785817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:12.790356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 461/933] 10.222.0.70 () {56 vars in 1132 bytes} [Wed May 18 22:24:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:12.791645 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:12.824287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:12.872429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ead91-f12b-4277-bdce-0cc32ccc7389 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:12.885150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:12.896570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f1203-d625-47b6-99dc-d23473f41ae7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:12.912463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dd9df-6f2b-4d83-b11f-c15651f1c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:12.913354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd9df-6f2b-4d83-b11f-c15651f1c9fd None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.913671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd9df-6f2b-4d83-b11f-c15651f1c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.913940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd9df-6f2b-4d83-b11f-c15651f1c9fd None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/39cd155a775f496ea9dd309eb3c47af2/roles/f5bde01204ea4412949dbb02c9e51a32` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.916362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dd9df-6f2b-4d83-b11f-c15651f1c9fd None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=39cd155a775f496ea9dd309eb3c47af2, role_id=f5bde01204ea4412949dbb02c9e51a32)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:12.917797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dd9df-6f2b-4d83-b11f-c15651f1c9fd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:12.933341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e19f8e-99ec-431d-bd51-f23bc0120cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:12.938656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e19f8e-99ec-431d-bd51-f23bc0120cdf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.938656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e19f8e-99ec-431d-bd51-f23bc0120cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.938656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e19f8e-99ec-431d-bd51-f23bc0120cdf None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.938656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e19f8e-99ec-431d-bd51-f23bc0120cdf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:12.938656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e19f8e-99ec-431d-bd51-f23bc0120cdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:12.938656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e19f8e-99ec-431d-bd51-f23bc0120cdf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:12.941604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 462/934] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:12.943092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3196-91c3-4715-bff6-f93f6c2b30f5 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.943377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3196-91c3-4715-bff6-f93f6c2b30f5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.943647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c3196-91c3-4715-bff6-f93f6c2b30f5 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:12.949538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 463/935] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:12.949538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c3196-91c3-4715-bff6-f93f6c2b30f5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:12.998040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 473/936] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:24:12 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/39cd155a775f496ea9dd309eb3c47af2/roles/f5bde01204ea4412949dbb02c9e51a32 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:24:12.998040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd378-ef6b-4f59-946d-78e933044624 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:12.998040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd378-ef6b-4f59-946d-78e933044624 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:12.998040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd378-ef6b-4f59-946d-78e933044624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:13.014340 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c1ebd378-ef6b-4f59-946d-78e933044624 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:13.015614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c1ebd378-ef6b-4f59-946d-78e933044624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:13.078200 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:13.090749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c3196-91c3-4715-bff6-f93f6c2b30f5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:13.127579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 474/937] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:13.131606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:13.132780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:13.133073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:13.133343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:13.138275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:13.138275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:13.138275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:13.143391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 464/938] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:13.149509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd378-ef6b-4f59-946d-78e933044624 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:13.150756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:13.260168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:13.263069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd378-ef6b-4f59-946d-78e933044624 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:13.267610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf3ea-6803-4601-b097-996597a6be44 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:13.300223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0f95-bc28-4ddf-af37-91d1a00cd1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:13.301144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0f95-bc28-4ddf-af37-91d1a00cd1b1 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:13.301521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0f95-bc28-4ddf-af37-91d1a00cd1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:13.301892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0f95-bc28-4ddf-af37-91d1a00cd1b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:13.302854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f0f95-bc28-4ddf-af37-91d1a00cd1b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:13.304890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f0f95-bc28-4ddf-af37-91d1a00cd1b1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:13.307092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:13.308264 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:13.308692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:13.309119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:13.309957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:13.311557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:13.325356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:13.326438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:13.327304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:13.329913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 465/939] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:13.336129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:13.363524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:13.379275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 475/940] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:24:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:13.466457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d31be6-5e1e-45b1-8608-2e7b549a0bc1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:13.517653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:13.518718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:13.519204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:13.519713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:13.520648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:13.521154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:13.522768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:13.529527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 466/941] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:13.535368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0f95-bc28-4ddf-af37-91d1a00cd1b1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:13.648261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0f95-bc28-4ddf-af37-91d1a00cd1b1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:13.684947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:13.685624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:13.685908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:13.686247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:13.686954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:13.687256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:13.688615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:13.693883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 476/942] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:13.700319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:13.791872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:13.809623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c0434-cb33-44a9-923b-abc03a2b0dc6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:13.846630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bddd4-46ab-4cfa-a178-44324ce69545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:13.847661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bddd4-46ab-4cfa-a178-44324ce69545 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:13.848151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bddd4-46ab-4cfa-a178-44324ce69545 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:13.848621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bddd4-46ab-4cfa-a178-44324ce69545 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:13.849623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bddd4-46ab-4cfa-a178-44324ce69545 None admin] RBAC: Adding query filter params (interface=public, service_id=90bfb39c141249fa809a089fcd36f5b4, region_id=RegionOne) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:13.850186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bddd4-46ab-4cfa-a178-44324ce69545 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:13.851952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bddd4-46ab-4cfa-a178-44324ce69545 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:13.858119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 467/943] 10.222.0.70 () {56 vars in 1251 bytes} [Wed May 18 22:24:13 2022] GET /identity/v3/endpoints?service_id=90bfb39c141249fa809a089fcd36f5b4&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:13.863333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:13.887165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:13.969180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cb3e4-e898-4a81-ab90-442966f22875 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:14.004201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece52a5-8797-43fb-9977-5e846a9163b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:14.005198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece52a5-8797-43fb-9977-5e846a9163b7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:14.005679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece52a5-8797-43fb-9977-5e846a9163b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:14.006220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece52a5-8797-43fb-9977-5e846a9163b7 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:14.007101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece52a5-8797-43fb-9977-5e846a9163b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:14.009176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece52a5-8797-43fb-9977-5e846a9163b7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:14.015809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 477/944] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:24:13 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:24:14.327892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfd93f-94a8-4eb9-b294-c343fdea54f8 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:14.328080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfd93f-94a8-4eb9-b294-c343fdea54f8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:14.328453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfd93f-94a8-4eb9-b294-c343fdea54f8 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:14.330108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 468/945] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:14.335524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44baed-8afe-4379-9197-b3a7f2e3dd83 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:14.335814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44baed-8afe-4379-9197-b3a7f2e3dd83 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:14.336075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44baed-8afe-4379-9197-b3a7f2e3dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:14.352681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ce44baed-8afe-4379-9197-b3a7f2e3dd83 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:14.353849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ce44baed-8afe-4379-9197-b3a7f2e3dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:14.426141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 478/946] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:14.450545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfd93f-94a8-4eb9-b294-c343fdea54f8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:14.556825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfd93f-94a8-4eb9-b294-c343fdea54f8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:14.591500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:14.592071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:14.592345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:14.592613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:14.593310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:14.594756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:14.596103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING keystone.server.flask.common [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 18 22:24:14.641424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.sql.core [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 22:24:14.641424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 18 22:24:14.641424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [parameters: {'id': '76a9aa98aac1458ca90d4de02541e351', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 18 22:24:14.641424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80364) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 76a9aa98aac1458ca90d4de02541e351.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 76a9aa98aac1458ca90d4de02541e351. May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 22:24:14.649262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 18 22:24:14.654224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return project_ref.to_dict() May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application yield resource May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.rollback() May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.force_reraise() May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise self.value May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application session.commit() May 18 22:24:14.655220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._prepare_impl() May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.flush() May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._flush(objects) May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application compat.raise_( May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application flush_context.execute() May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 22:24:14.656149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rec.execute(self) May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application c = connection._execute_20( May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 22:24:14.658142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 22:24:14.660024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [parameters: {'id': '76a9aa98aac1458ca90d4de02541e351', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:14.662155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:14.664984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.Conflict( May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 76a9aa98aac1458ca90d4de02541e351. May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:14.667149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 469/947] 10.222.0.70 () {60 vars in 1140 bytes} [Wed May 18 22:24:14 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:14.668440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44baed-8afe-4379-9197-b3a7f2e3dd83 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:14.678431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:14.773946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44baed-8afe-4379-9197-b3a7f2e3dd83 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:14.810931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0b170-1b16-4e1f-b637-00b0e7288429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:14.812128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b170-1b16-4e1f-b637-00b0e7288429 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:14.812615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b170-1b16-4e1f-b637-00b0e7288429 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:14.813112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0b170-1b16-4e1f-b637-00b0e7288429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:14.821131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0b170-1b16-4e1f-b637-00b0e7288429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:14.822939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0b170-1b16-4e1f-b637-00b0e7288429 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d2e0b170-1b16-4e1f-b637-00b0e7288429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:14.837684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:14.838636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:14.839571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:14.839571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:14.839571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:14.839571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:14.839571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:14.839571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:14.839571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:14.839571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:14.842119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 479/948] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:14.850696 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:14.852842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:14.957463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314e83e-8124-4b25-adb7-7e99645c1326 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:14.992686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e372d78-e7b2-47e0-8e99-5625dbb4237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:14.993338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372d78-e7b2-47e0-8e99-5625dbb4237e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:14.993610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372d78-e7b2-47e0-8e99-5625dbb4237e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:14.993875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372d78-e7b2-47e0-8e99-5625dbb4237e None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:14.994649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e372d78-e7b2-47e0-8e99-5625dbb4237e None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:14.994948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e372d78-e7b2-47e0-8e99-5625dbb4237e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:14.996567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e372d78-e7b2-47e0-8e99-5625dbb4237e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:15.022170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 470/949] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:24:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:15.328898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ff82-1aa5-4df8-8443-5a6141267bf5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:15.329245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ff82-1aa5-4df8-8443-5a6141267bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:15.329535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ff82-1aa5-4df8-8443-5a6141267bf5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:15.331145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 480/950] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:15.337336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761029-50ef-4ea0-b3bd-44acb662da2a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:15.337629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761029-50ef-4ea0-b3bd-44acb662da2a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:15.337910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761029-50ef-4ea0-b3bd-44acb662da2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:15.356607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d9761029-50ef-4ea0-b3bd-44acb662da2a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:15.358150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d9761029-50ef-4ea0-b3bd-44acb662da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:15.419125 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:15.427687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 471/951] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:15.452578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ff82-1aa5-4df8-8443-5a6141267bf5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:15.537301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:15.563658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ff82-1aa5-4df8-8443-5a6141267bf5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:15.600175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ae7a-4931-4059-9954-f8f432061885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:15.601270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ae7a-4931-4059-9954-f8f432061885 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:15.601751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ae7a-4931-4059-9954-f8f432061885 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:15.602217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ae7a-4931-4059-9954-f8f432061885 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:15.614889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ae7a-4931-4059-9954-f8f432061885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2673ae7a-4931-4059-9954-f8f432061885 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:15.623984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:15.625331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:15.626501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:15.629179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 481/952] 10.222.0.70 () {56 vars in 1120 bytes} [Wed May 18 22:24:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:15.640316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761029-50ef-4ea0-b3bd-44acb662da2a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:15.745025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761029-50ef-4ea0-b3bd-44acb662da2a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:15.780345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf6566-c2fc-48b7-b8e4-ec03d3613d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:15.781016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6566-c2fc-48b7-b8e4-ec03d3613d88 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:15.781295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6566-c2fc-48b7-b8e4-ec03d3613d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:15.781564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf6566-c2fc-48b7-b8e4-ec03d3613d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:15.782337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf6566-c2fc-48b7-b8e4-ec03d3613d88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:15.782639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf6566-c2fc-48b7-b8e4-ec03d3613d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:15.784005 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf6566-c2fc-48b7-b8e4-ec03d3613d88 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:15.792970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 472/953] 10.222.0.70 () {56 vars in 1115 bytes} [Wed May 18 22:24:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:15.798896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ae7a-4931-4059-9954-f8f432061885 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:15.806518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e02a8-98cd-44b6-8b92-268b297839ab None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:15.806803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e02a8-98cd-44b6-8b92-268b297839ab None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:15.807077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e02a8-98cd-44b6-8b92-268b297839ab None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:15.808713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 473/954] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:15.815601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1c96-570e-4bb4-bf1c-edfa2af04a6f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:15.815885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1c96-570e-4bb4-bf1c-edfa2af04a6f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:15.816161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e1c96-570e-4bb4-bf1c-edfa2af04a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:15.835144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-932e1c96-570e-4bb4-bf1c-edfa2af04a6f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:15.836378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-932e1c96-570e-4bb4-bf1c-edfa2af04a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:15.902386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:15.911452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 474/955] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:15.925177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ae7a-4931-4059-9954-f8f432061885 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:15.935350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e1c96-570e-4bb4-bf1c-edfa2af04a6f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:15.973488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:15.974677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:15.975297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:15.976719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:15.978948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:15.991073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:15.993741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:16.018316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:16.019287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:16.020290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:16.020290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:16.020290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:16.020290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:16.022350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 482/956] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:16.027447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:16.071666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e1c96-570e-4bb4-bf1c-edfa2af04a6f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:16.109504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:16.110874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.111361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.112294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.113462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:16.116078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:16.131858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:16.133551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:16.137003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:16.138135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 475/957] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:16.142324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:16.153897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a66879-f92a-400a-942e-f46c1b23feee None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:16.189417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:16.190120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.190409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.190686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.191405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:16.191713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:16.193345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:16.208722 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:16.210262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 483/958] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:16.212951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:16.270577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:16.286870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91325b-0b2f-4a4a-b0e7-32e4b3bafb8a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:16.325911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1568b-bae4-4a9b-8b62-62266cd2d2eb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:16.326280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:16.327139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.327655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.328244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.329143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:16.329687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:16.331381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:16.338395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 476/959] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:24:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:16.343793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:16.375949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c296e-68d7-4b82-ac66-c4168562e5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:16.378081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c296e-68d7-4b82-ac66-c4168562e5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.379143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c296e-68d7-4b82-ac66-c4168562e5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.379627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c296e-68d7-4b82-ac66-c4168562e5e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.394823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c296e-68d7-4b82-ac66-c4168562e5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:16.397618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c296e-68d7-4b82-ac66-c4168562e5e2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7e9c296e-68d7-4b82-ac66-c4168562e5e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:16.425076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:16.426155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 22:24:16.427110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:16.434818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 484/960] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:24:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:16.436447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972da6cc-abbf-4880-8945-242a5eb9c337 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.436930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972da6cc-abbf-4880-8945-242a5eb9c337 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.437401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972da6cc-abbf-4880-8945-242a5eb9c337 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.438891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 485/961] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:16.440078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972da6cc-abbf-4880-8945-242a5eb9c337 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:16.501830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e060f47-26d1-475a-97d4-f23f086664ea None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:16.519944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:16.553277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70200d9b-0ce2-4271-b63d-e22465023760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:16.553912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200d9b-0ce2-4271-b63d-e22465023760 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.554767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200d9b-0ce2-4271-b63d-e22465023760 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.555045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200d9b-0ce2-4271-b63d-e22465023760 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.555758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70200d9b-0ce2-4271-b63d-e22465023760 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:16.556064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70200d9b-0ce2-4271-b63d-e22465023760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:16.557428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70200d9b-0ce2-4271-b63d-e22465023760 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:16.574870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 477/962] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:24:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:16.576560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d534-8de5-4933-8dae-645858e7f3a3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.576880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d534-8de5-4933-8dae-645858e7f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.577159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d534-8de5-4933-8dae-645858e7f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.588160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972da6cc-abbf-4880-8945-242a5eb9c337 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:16.597425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-56c1d534-8de5-4933-8dae-645858e7f3a3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:16.599100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:16.600403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-56c1d534-8de5-4933-8dae-645858e7f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:16.640249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:16.643456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.644575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.645343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.647081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:16.648692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:16.651749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:16.697299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 486/963] 10.222.0.70 () {56 vars in 1149 bytes} [Wed May 18 22:24:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:16.703035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:16.748652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 478/964] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:16.771745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1d534-8de5-4933-8dae-645858e7f3a3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:16.883250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80de2d-b20c-42de-b2c7-11a076524ab8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:16.949176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274244b0-9adb-4c13-a1e2-9929f4825f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:16.949887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274244b0-9adb-4c13-a1e2-9929f4825f53 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:16.950487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274244b0-9adb-4c13-a1e2-9929f4825f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:16.950769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274244b0-9adb-4c13-a1e2-9929f4825f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:16.954101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1d534-8de5-4933-8dae-645858e7f3a3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:16.966992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:16.993880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:16.997659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:16.998707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.000076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.000193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.000955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.002867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:17.019774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:17.020881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:17.021762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:17.026433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 479/965] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:17.027908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.052463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274244b0-9adb-4c13-a1e2-9929f4825f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.054080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274244b0-9adb-4c13-a1e2-9929f4825f53 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.157686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55ae16-0aa6-4cf5-9353-ebd7e26fc177 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:17.188561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 487/966] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:16 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 22:24:17.189363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274244b0-9adb-4c13-a1e2-9929f4825f53 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.206537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:17.208234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.208840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.209337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.211212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:17.212306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.213910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.222545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 480/967] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:17.228121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.267224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:17.276128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:17.330833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274244b0-9adb-4c13-a1e2-9929f4825f53 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:17.337628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834306e-98eb-4373-9845-d5f96041116d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:17.377417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a35e2-10c1-4aea-af17-a935a512d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:17.378257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a35e2-10c1-4aea-af17-a935a512d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.378366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5113a4-0b64-4e54-b7b1-ccc39a860425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:17.378562 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a35e2-10c1-4aea-af17-a935a512d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.378810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a35e2-10c1-4aea-af17-a935a512d2b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.378907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5113a4-0b64-4e54-b7b1-ccc39a860425 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.379174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5113a4-0b64-4e54-b7b1-ccc39a860425 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.379445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5113a4-0b64-4e54-b7b1-ccc39a860425 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.380144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5113a4-0b64-4e54-b7b1-ccc39a860425 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:17.380443 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5113a4-0b64-4e54-b7b1-ccc39a860425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.381836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5113a4-0b64-4e54-b7b1-ccc39a860425 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.387811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 481/968] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:17.392379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddce651-85fe-49e5-a4f9-3f54aa8503ee None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.392379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddce651-85fe-49e5-a4f9-3f54aa8503ee None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.392379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddce651-85fe-49e5-a4f9-3f54aa8503ee None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.392644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a35e2-10c1-4aea-af17-a935a512d2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.392737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 482/969] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:17.392812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a35e2-10c1-4aea-af17-a935a512d2b9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.393204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddce651-85fe-49e5-a4f9-3f54aa8503ee None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6b4a35e2-10c1-4aea-af17-a935a512d2b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:17.411201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:17.412173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:17.413139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:17.413139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:17.413139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:17.413139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:17.417021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 488/970] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:17.418371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a94b6-6873-44c3-9515-430a25061350 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.418659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a94b6-6873-44c3-9515-430a25061350 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.418949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a94b6-6873-44c3-9515-430a25061350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.436478 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4f4a94b6-6873-44c3-9515-430a25061350 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:17.437659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4f4a94b6-6873-44c3-9515-430a25061350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:17.498593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:17.502892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddce651-85fe-49e5-a4f9-3f54aa8503ee None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:17.509592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 489/971] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:17.512407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a94b6-6873-44c3-9515-430a25061350 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.541824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db919-8eb6-4fe6-a82b-ccb3922cf0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:17.542514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db919-8eb6-4fe6-a82b-ccb3922cf0ca None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.542802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db919-8eb6-4fe6-a82b-ccb3922cf0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.543484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db919-8eb6-4fe6-a82b-ccb3922cf0ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.544631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db919-8eb6-4fe6-a82b-ccb3922cf0ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.546673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db919-8eb6-4fe6-a82b-ccb3922cf0ca None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.564570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:17.616009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a94b6-6873-44c3-9515-430a25061350 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:17.634036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 483/972] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:24:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:17.634036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db919-8eb6-4fe6-a82b-ccb3922cf0ca None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.674583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:17.675317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.675604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.675879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.676665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:17.676976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.678666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.698491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 490/973] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:17.699492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.762660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db919-8eb6-4fe6-a82b-ccb3922cf0ca None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:17.799822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:17.800550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.800829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.801098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.801803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.803300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.822828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a774a1b-98eb-4b29-8d1a-588d165a7866 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:17.826364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:17.841921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.sql.core [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 22:24:17.841921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 18 22:24:17.841921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [parameters: {'user_id': '8712df3b7dd4482d992a6d2b1f533fbb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 18 22:24:17.841921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80364) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 18 22:24:17.853189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 22:24:17.855323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application yield resource May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application next(self.gen) May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.rollback() May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.force_reraise() May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise self.value May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application session.commit() May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 22:24:17.857802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._prepare_impl() May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.session.flush() May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._flush(objects) May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application compat.raise_( May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application flush_context.execute() May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rec.execute(self) May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 22:24:17.858875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = connection._execute_20( May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 22:24:17.859933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result = self._query(query) May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application conn.query(q) May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application result.read() May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 22:24:17.862431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [parameters: {'user_id': '8712df3b7dd4482d992a6d2b1f533fbb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:17.864668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 18 22:24:17.867332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 18 22:24:17.869541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 18 22:24:17.869541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 18 22:24:17.869541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 22:24:17.869541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 22:24:17.869541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 18 22:24:17.869541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:17.869541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 484/974] 10.222.0.70 () {60 vars in 1131 bytes} [Wed May 18 22:24:17 2022] POST /identity/v3/users => generated 160 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:17.869541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.870655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:17.870655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:17.870655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:17.871083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:17.879630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:17.881109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:17.891427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:17.898485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:17.899434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:17.901201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 491/975] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:17.907088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:17.986323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e88ddd-d12f-4cc4-9161-309b9a26413f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:18.020624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d276c83-cc4f-4a7e-a64e-1ee9099cbde3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:18.025584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:18.026684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:18.027173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:18.027719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:18.035502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:18.037371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:18.053882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:18.056079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 22:24:18.057083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:18.064304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 485/976] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:24:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:18.065600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:18.068458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:18.068745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:18.069030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:18.069305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:18.070347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:18.070906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:18.072805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:18.090138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 492/977] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:18.091767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:18.119134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:18.158405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:18.178069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674f5e1-2cbb-420d-b37f-e5beecdea920 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:18.201177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2ffd9-b475-482e-8567-8a37c6dbd824 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:18.223771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b14f1-29f1-453f-bf25-03b9dfdbd90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:18.224468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b14f1-29f1-453f-bf25-03b9dfdbd90d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:18.225032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b14f1-29f1-453f-bf25-03b9dfdbd90d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:18.225313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b14f1-29f1-453f-bf25-03b9dfdbd90d None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:18.227678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b14f1-29f1-453f-bf25-03b9dfdbd90d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:18.227991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b14f1-29f1-453f-bf25-03b9dfdbd90d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:18.230324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b14f1-29f1-453f-bf25-03b9dfdbd90d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:18.237270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567f81a-b7aa-4823-bd09-31d451b2233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:18.237920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f81a-b7aa-4823-bd09-31d451b2233a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:18.238239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f81a-b7aa-4823-bd09-31d451b2233a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:18.238515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567f81a-b7aa-4823-bd09-31d451b2233a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:18.239351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567f81a-b7aa-4823-bd09-31d451b2233a None admin] RBAC: Adding query filter params (role.id=f5bde01204ea4412949dbb02c9e51a32, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=39cd155a775f496ea9dd309eb3c47af2) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:18.239720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567f81a-b7aa-4823-bd09-31d451b2233a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:18.241192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567f81a-b7aa-4823-bd09-31d451b2233a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:18.254473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 493/978] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:18 2022] GET /identity/v3/role_assignments?user.id=39cd155a775f496ea9dd309eb3c47af2&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=f5bde01204ea4412949dbb02c9e51a32 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:18.274746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 486/979] 10.222.0.70 () {56 vars in 1101 bytes} [Wed May 18 22:24:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:18.878455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a26b3-1fe8-4124-aaa0-edf2c4c11d66 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:18.879001 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a26b3-1fe8-4124-aaa0-edf2c4c11d66 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:18.879001 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a26b3-1fe8-4124-aaa0-edf2c4c11d66 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:18.880479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 494/980] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:18.885584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b0436-2aa9-4dd5-9f29-19a18a145c21 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:18.885990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b0436-2aa9-4dd5-9f29-19a18a145c21 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:18.886192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b0436-2aa9-4dd5-9f29-19a18a145c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:18.903379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-bc3b0436-2aa9-4dd5-9f29-19a18a145c21 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:18.904859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bc3b0436-2aa9-4dd5-9f29-19a18a145c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:18.974036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 487/981] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:18.996937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a26b3-1fe8-4124-aaa0-edf2c4c11d66 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:19.090464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:19.106647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a26b3-1fe8-4124-aaa0-edf2c4c11d66 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:19.141642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9d03b-8c0a-480d-adc4-a640dd67ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:19.142339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9d03b-8c0a-480d-adc4-a640dd67ff0e None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:19.142671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9d03b-8c0a-480d-adc4-a640dd67ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:19.142996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9d03b-8c0a-480d-adc4-a640dd67ff0e None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:19.143767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9d03b-8c0a-480d-adc4-a640dd67ff0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:19.145177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9d03b-8c0a-480d-adc4-a640dd67ff0e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:19.207620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 495/982] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:24:18 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:19.978313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57225-97af-4ec5-9811-e94d696f7abe None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:19.978839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57225-97af-4ec5-9811-e94d696f7abe None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:19.978839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57225-97af-4ec5-9811-e94d696f7abe None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:19.980370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 488/983] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:19.985581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835079c4-246c-4f15-867c-5d6bd0c0acc7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:19.985964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835079c4-246c-4f15-867c-5d6bd0c0acc7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:19.986174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835079c4-246c-4f15-867c-5d6bd0c0acc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.003609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-835079c4-246c-4f15-867c-5d6bd0c0acc7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:20.004783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-835079c4-246c-4f15-867c-5d6bd0c0acc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:20.094046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 496/984] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:20.114781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc57225-97af-4ec5-9811-e94d696f7abe None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:20.183621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:20.219922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc57225-97af-4ec5-9811-e94d696f7abe None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:20.254127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:20.254848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:20.255130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:20.255407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.256057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:20.257990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:20.270155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:20.271176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:20.272070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:20.274085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 489/985] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:20.277703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835079c4-246c-4f15-867c-5d6bd0c0acc7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:20.349686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:20.381171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835079c4-246c-4f15-867c-5d6bd0c0acc7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:20.420990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:20.421672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:20.421954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:20.422262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.422987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:20.423294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:20.424685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:20.437345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 497/986] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:20.437557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:20.542148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f88f5-a570-4329-bc9e-f47eb274343e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:20.570465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:20.576680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37b6fd-b5bb-4e93-ad3f-d7bb5da3c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:20.577337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37b6fd-b5bb-4e93-ad3f-d7bb5da3c822 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:20.577747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37b6fd-b5bb-4e93-ad3f-d7bb5da3c822 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:20.577958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37b6fd-b5bb-4e93-ad3f-d7bb5da3c822 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.578691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37b6fd-b5bb-4e93-ad3f-d7bb5da3c822 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:20.580148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37b6fd-b5bb-4e93-ad3f-d7bb5da3c822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:20.580364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37b6fd-b5bb-4e93-ad3f-d7bb5da3c822 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:20.585879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 490/987] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:20.591685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:20.593397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b99c1-f0e8-4212-81eb-8cabf15f1f8b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:20.593684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b99c1-f0e8-4212-81eb-8cabf15f1f8b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:20.593961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b99c1-f0e8-4212-81eb-8cabf15f1f8b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.596658 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 491/988] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:20.600402 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ef50-ca8c-41d0-9f6b-8c75bf00c779 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:20.600694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ef50-ca8c-41d0-9f6b-8c75bf00c779 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:20.601028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ef50-ca8c-41d0-9f6b-8c75bf00c779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.618567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8644ef50-ca8c-41d0-9f6b-8c75bf00c779 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:20.619743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8644ef50-ca8c-41d0-9f6b-8c75bf00c779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:20.691574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 492/989] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:20.700789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a6564-ae68-4871-89ec-dee0f4677b75 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:20.714649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644ef50-ca8c-41d0-9f6b-8c75bf00c779 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:20.738953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:20.739763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:20.740058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:20.740633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.742843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] RBAC: Adding query filter params (interface=admin, service_id=90bfb39c141249fa809a089fcd36f5b4, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:20.743330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:20.745313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:20.748632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:20.757375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 498/990] 10.222.0.70 () {56 vars in 1249 bytes} [Wed May 18 22:24:20 2022] GET /identity/v3/endpoints?service_id=90bfb39c141249fa809a089fcd36f5b4&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:20.758985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:20.822508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644ef50-ca8c-41d0-9f6b-8c75bf00c779 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:20.847179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:20.859922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:20.860709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:20.861017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:20.861247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.861884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:20.863312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:20.871756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ace45e-c39e-40c5-8487-dcbf31b01cbe None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:20.876995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:20.878044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:20.879299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 493/991] 10.222.0.70 () {56 vars in 1105 bytes} [Wed May 18 22:24:20 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:20.884578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:20.910411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda28a4-d59b-4a8f-af5b-98bc23f42ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:20.911047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda28a4-d59b-4a8f-af5b-98bc23f42ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:20.911320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda28a4-d59b-4a8f-af5b-98bc23f42ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:20.911775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda28a4-d59b-4a8f-af5b-98bc23f42ea4 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:20.912284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda28a4-d59b-4a8f-af5b-98bc23f42ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:20.914335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda28a4-d59b-4a8f-af5b-98bc23f42ea4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:20.921148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 499/992] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:24:20 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:24:20.999971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248d757-d0b2-4f5d-9b21-82e8f26863a4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:21.042049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c624e9c-768b-4316-9726-d786fc3feb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:21.042049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624e9c-768b-4316-9726-d786fc3feb69 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:21.042049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624e9c-768b-4316-9726-d786fc3feb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:21.042049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c624e9c-768b-4316-9726-d786fc3feb69 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:21.042508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c624e9c-768b-4316-9726-d786fc3feb69 None admin] RBAC: Adding query filter params (name=image) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:21.042508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c624e9c-768b-4316-9726-d786fc3feb69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:21.042969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c624e9c-768b-4316-9726-d786fc3feb69 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:21.048826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 494/993] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:21.057686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda28a4-d59b-4a8f-af5b-98bc23f42ea4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:21.129114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:21.170751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda28a4-d59b-4a8f-af5b-98bc23f42ea4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:21.208250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211a8b5-47ea-42ff-bcfe-dc6bf923936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:21.208912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a8b5-47ea-42ff-bcfe-dc6bf923936b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:21.209194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a8b5-47ea-42ff-bcfe-dc6bf923936b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:21.209470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a8b5-47ea-42ff-bcfe-dc6bf923936b None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:21.210209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211a8b5-47ea-42ff-bcfe-dc6bf923936b None admin] RBAC: Adding query filter params (type=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:21.210587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211a8b5-47ea-42ff-bcfe-dc6bf923936b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:21.212015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211a8b5-47ea-42ff-bcfe-dc6bf923936b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:21.222030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 500/994] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:21.465850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5083-988d-4312-86d3-2051d4fe2709 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:21.466219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5083-988d-4312-86d3-2051d4fe2709 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:21.466401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca5083-988d-4312-86d3-2051d4fe2709 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:21.467876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 495/995] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:21.472840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815965f-ae1e-4ab4-a04e-a15165cc5768 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:21.473133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815965f-ae1e-4ab4-a04e-a15165cc5768 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:21.473416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815965f-ae1e-4ab4-a04e-a15165cc5768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:21.490512 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c815965f-ae1e-4ab4-a04e-a15165cc5768 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:21.492312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c815965f-ae1e-4ab4-a04e-a15165cc5768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:21.561675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 501/996] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:21.584111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca5083-988d-4312-86d3-2051d4fe2709 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:21.639605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:21.689311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca5083-988d-4312-86d3-2051d4fe2709 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:21.726029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:21.726904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:21.727184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:21.727456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:21.728104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:21.729463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:21.741414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:21.743642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:21.744927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:21.746371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 496/997] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:21.749265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815965f-ae1e-4ab4-a04e-a15165cc5768 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:21.807379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:21.849115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815965f-ae1e-4ab4-a04e-a15165cc5768 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:21.883755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:21.884413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:21.884692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:21.884965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:21.885662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:21.885967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:21.887346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:21.894360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 502/998] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:24:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:21.897756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:21.998389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc331a-cdc9-4091-9b04-ccb467980cec None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:22.014794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:22.033169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:22.033828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:22.034137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:22.034414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:22.035114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] RBAC: Adding query filter params (type=compute) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:22.035417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:22.039809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:22.051583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 497/999] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:24:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:22.053373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:22.160515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066f3d1-46e4-47d0-9302-d189f6b23fcd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:22.184932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:22.197007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0837fd-5903-4479-9e3f-bebccaea2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:22.197655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0837fd-5903-4479-9e3f-bebccaea2e06 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:22.197929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0837fd-5903-4479-9e3f-bebccaea2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:22.198230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0837fd-5903-4479-9e3f-bebccaea2e06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:22.199007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0837fd-5903-4479-9e3f-bebccaea2e06 None admin] RBAC: Adding query filter params (interface=public, service_id=5f4eff1b94e7478cb2fa43e95b1c7557, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:22.199311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0837fd-5903-4479-9e3f-bebccaea2e06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:22.200654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0837fd-5903-4479-9e3f-bebccaea2e06 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:22.210089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 503/1000] 10.222.0.70 () {56 vars in 1251 bytes} [Wed May 18 22:24:22 2022] GET /identity/v3/endpoints?service_id=5f4eff1b94e7478cb2fa43e95b1c7557&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:22.213862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:22.317737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a5b59-1454-41a0-9508-391c8adce3ee None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:22.353916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109c217-3cda-4400-8cc5-c42cd241c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:22.354766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109c217-3cda-4400-8cc5-c42cd241c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:22.355049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109c217-3cda-4400-8cc5-c42cd241c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:22.355320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109c217-3cda-4400-8cc5-c42cd241c0d3 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:22.355997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109c217-3cda-4400-8cc5-c42cd241c0d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:22.357359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109c217-3cda-4400-8cc5-c42cd241c0d3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:22.363867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 498/1001] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:24:22 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:24:23.164676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df556-2fae-4c84-928f-5c79fbd2140f None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.165200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df556-2fae-4c84-928f-5c79fbd2140f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.165200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059df556-2fae-4c84-928f-5c79fbd2140f None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.166633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 504/1002] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:23.171834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeafb6-5c6a-4f3f-85f7-f9a9d3471360 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.172283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeafb6-5c6a-4f3f-85f7-f9a9d3471360 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.172462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeafb6-5c6a-4f3f-85f7-f9a9d3471360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.189694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-63eeafb6-5c6a-4f3f-85f7-f9a9d3471360 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:23.190919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-63eeafb6-5c6a-4f3f-85f7-f9a9d3471360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:23.233722 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:23.262034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 499/1003] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:23.285696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059df556-2fae-4c84-928f-5c79fbd2140f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:23.392768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059df556-2fae-4c84-928f-5c79fbd2140f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:23.427504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9c945-be60-41cc-a2fa-02534a789152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:23.428415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c945-be60-41cc-a2fa-02534a789152 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.428699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c945-be60-41cc-a2fa-02534a789152 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.429500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c945-be60-41cc-a2fa-02534a789152 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.430188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9c945-be60-41cc-a2fa-02534a789152 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:23.431557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9c945-be60-41cc-a2fa-02534a789152 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f5c9c945-be60-41cc-a2fa-02534a789152 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:23.444180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:23.445864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 22:24:23.446827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:23.450785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 505/1004] 10.222.0.70 () {56 vars in 1126 bytes} [Wed May 18 22:24:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:23.452684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeafb6-5c6a-4f3f-85f7-f9a9d3471360 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:23.469563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75e5d1-9ffa-4d42-8e14-8e7381299c5c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.469878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75e5d1-9ffa-4d42-8e14-8e7381299c5c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.470067 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75e5d1-9ffa-4d42-8e14-8e7381299c5c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.471572 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 506/1005] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:23.476284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55ad0-8d9b-460e-bf54-88c957ed363f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.477725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55ad0-8d9b-460e-bf54-88c957ed363f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.477725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55ad0-8d9b-460e-bf54-88c957ed363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.495460 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-71c55ad0-8d9b-460e-bf54-88c957ed363f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:23.496687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-71c55ad0-8d9b-460e-bf54-88c957ed363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:23.548925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:23.570510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeafb6-5c6a-4f3f-85f7-f9a9d3471360 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:23.573043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 507/1006] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:23.595776 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55ad0-8d9b-460e-bf54-88c957ed363f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:23.608234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:23.608892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.609165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.609468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.610186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:23.610489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:23.611849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:23.617040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 500/1007] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:23.622320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:23.666795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:23.700221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55ad0-8d9b-460e-bf54-88c957ed363f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:23.731434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dff4b-15fb-482b-86a1-45893d72c1f4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:23.733738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f44c8-1e24-40f3-8cab-63a8e7209f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:23.734472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f44c8-1e24-40f3-8cab-63a8e7209f9a None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.734749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f44c8-1e24-40f3-8cab-63a8e7209f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.735037 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f44c8-1e24-40f3-8cab-63a8e7209f9a None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.735746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f44c8-1e24-40f3-8cab-63a8e7209f9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:23.737085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f44c8-1e24-40f3-8cab-63a8e7209f9a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:23.764964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:23.765613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.765886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.766189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.766909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:23.767206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:23.768546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:23.774447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 501/1008] 10.222.0.70 () {56 vars in 1122 bytes} [Wed May 18 22:24:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:23.780066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:23.830449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 508/1009] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:24:23 2022] POST /identity/v3/services => generated 242 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:24:23.885372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2639-68ba-4210-ad44-15d10a4c3a97 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:23.887167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:23.932599 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd4125-f711-4b7e-8651-4c9a5dcd843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:23.933236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd4125-f711-4b7e-8651-4c9a5dcd843d None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:23.933518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd4125-f711-4b7e-8651-4c9a5dcd843d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:23.933792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd4125-f711-4b7e-8651-4c9a5dcd843d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:23.934612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd4125-f711-4b7e-8651-4c9a5dcd843d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:23.935998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd4125-f711-4b7e-8651-4c9a5dcd843d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:24.014057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 502/1010] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:24:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:24:24.641186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28b78-04e1-46c5-9081-2bf237e8c81d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:24.641743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28b78-04e1-46c5-9081-2bf237e8c81d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:24.641743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28b78-04e1-46c5-9081-2bf237e8c81d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:24.643262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 509/1011] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:24.648591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a566-457d-4ade-95ea-b2237d866969 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:24.648987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a566-457d-4ade-95ea-b2237d866969 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:24.649202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6a566-457d-4ade-95ea-b2237d866969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:24.666343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2be6a566-457d-4ade-95ea-b2237d866969 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:24.667524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2be6a566-457d-4ade-95ea-b2237d866969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:24.746064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 503/1012] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:24 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:24.769186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28b78-04e1-46c5-9081-2bf237e8c81d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:24.813177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:24.873030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28b78-04e1-46c5-9081-2bf237e8c81d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:24.906887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:24.907601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:24.907884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:24.908158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:24.908803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:24.910184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:24.922389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:24.923401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 22:24:24.924263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:24.926318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 510/1013] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:24.930562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6a566-457d-4ade-95ea-b2237d866969 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:25.017991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:25.033857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6a566-457d-4ade-95ea-b2237d866969 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:25.073988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:25.074689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:25.074972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:25.075248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:25.075957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:25.076263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:25.077638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:25.082877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 504/1014] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:24:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:25.088691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:25.195589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d38ca-b88b-461a-a27a-bafea3cff723 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:25.197859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:25.231572 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd67d30-b03f-4297-8858-6c1a35283e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:25.232232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd67d30-b03f-4297-8858-6c1a35283e59 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:25.232516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd67d30-b03f-4297-8858-6c1a35283e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:25.232793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd67d30-b03f-4297-8858-6c1a35283e59 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:25.233506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd67d30-b03f-4297-8858-6c1a35283e59 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:25.233814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd67d30-b03f-4297-8858-6c1a35283e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:25.235225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd67d30-b03f-4297-8858-6c1a35283e59 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:25.245289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 511/1015] 10.222.0.70 () {56 vars in 1112 bytes} [Wed May 18 22:24:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:25.246556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:25.348844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c8f10-615f-4221-8802-d5344ac3a2b8 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:25.382693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfe3b8-4ea7-4fd3-b48b-b5078b83cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:25.383348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfe3b8-4ea7-4fd3-b48b-b5078b83cb9d None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:25.383628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfe3b8-4ea7-4fd3-b48b-b5078b83cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:25.383900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfe3b8-4ea7-4fd3-b48b-b5078b83cb9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:25.384629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfe3b8-4ea7-4fd3-b48b-b5078b83cb9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:25.386016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfe3b8-4ea7-4fd3-b48b-b5078b83cb9d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:25.436678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 505/1016] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:24:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:24:26.120180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93bfed-5f80-46d7-a86b-b8a52a9b59dc None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.120700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93bfed-5f80-46d7-a86b-b8a52a9b59dc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.120700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93bfed-5f80-46d7-a86b-b8a52a9b59dc None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.122230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 512/1017] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:26.127270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4dc63-08ac-48c4-a0a6-eb70071aee7d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.127662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4dc63-08ac-48c4-a0a6-eb70071aee7d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.127822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4dc63-08ac-48c4-a0a6-eb70071aee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.135350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:26.146519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8ee4dc63-08ac-48c4-a0a6-eb70071aee7d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:26.147770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8ee4dc63-08ac-48c4-a0a6-eb70071aee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:26.223692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 506/1018] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:26.247390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93bfed-5f80-46d7-a86b-b8a52a9b59dc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:26.251606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1d5c6-5241-4ca7-9f23-13613a26edba None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.251894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1d5c6-5241-4ca7-9f23-13613a26edba None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.252168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1d5c6-5241-4ca7-9f23-13613a26edba None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.253538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 507/1019] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:26.258514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9f61b-0912-4e00-84e1-19fa2564cff3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.258798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9f61b-0912-4e00-84e1-19fa2564cff3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.259075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9f61b-0912-4e00-84e1-19fa2564cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.276182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-02d9f61b-0912-4e00-84e1-19fa2564cff3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:26.277368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-02d9f61b-0912-4e00-84e1-19fa2564cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:26.348102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 508/1020] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:26.359393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93bfed-5f80-46d7-a86b-b8a52a9b59dc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:26.371600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9f61b-0912-4e00-84e1-19fa2564cff3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:26.394981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:26.396045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.396470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.396885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] PATH_INFO: `/v3/services/image` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.398310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:26.399815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:26.411330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:26.412591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:26.414331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 513/1021] 10.222.0.70 () {56 vars in 1105 bytes} [Wed May 18 22:24:26 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:26.419049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:26.435845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:26.452928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:26.478739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9f61b-0912-4e00-84e1-19fa2564cff3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:26.516112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb637-f338-44bf-a5e3-cec0a0f77902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:26.516914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb637-f338-44bf-a5e3-cec0a0f77902 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.517173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb637-f338-44bf-a5e3-cec0a0f77902 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.517440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecb637-f338-44bf-a5e3-cec0a0f77902 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.518704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb637-f338-44bf-a5e3-cec0a0f77902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:26.520151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecb637-f338-44bf-a5e3-cec0a0f77902 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:26.521916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 509/1022] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:26.524708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e5566-cfd6-433d-893b-8a870056236f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:26.527473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb637-f338-44bf-a5e3-cec0a0f77902 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:26.561272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:26.562264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.562611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.562881 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.563605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:26.563905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:26.565241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:26.571171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 514/1023] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:26.576959 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:26.631954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecb637-f338-44bf-a5e3-cec0a0f77902 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:26.660915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:26.672399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbbae1-36fe-461a-a675-f7d0f9dfe554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:26.673263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbbae1-36fe-461a-a675-f7d0f9dfe554 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.673539 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbbae1-36fe-461a-a675-f7d0f9dfe554 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.673889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbbae1-36fe-461a-a675-f7d0f9dfe554 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.674562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbbae1-36fe-461a-a675-f7d0f9dfe554 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:26.676456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbbae1-36fe-461a-a675-f7d0f9dfe554 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:26.679937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:26.685844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23185e88-942b-4cf9-8e93-8eef77a2a6f5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:26.719755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:26.720467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.720953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.721395 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.722548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] RBAC: Adding query filter params (type=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:26.722851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:26.724200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:26.729598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 515/1024] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:26.735367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:26.758395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 510/1025] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:24:26 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:24:26.851416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60bb6-1f1e-4c74-8669-5699bd6f7942 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:26.887753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918ef1a-6d5d-467b-a78a-6bc3d6ccaaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:26.888336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918ef1a-6d5d-467b-a78a-6bc3d6ccaaab None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:26.888620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918ef1a-6d5d-467b-a78a-6bc3d6ccaaab None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:26.888896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918ef1a-6d5d-467b-a78a-6bc3d6ccaaab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:26.889699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918ef1a-6d5d-467b-a78a-6bc3d6ccaaab None admin] RBAC: Adding query filter params (interface=public, service_id=a96fe5e9912143f1a4bcc3382abe5c87, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:26.890030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918ef1a-6d5d-467b-a78a-6bc3d6ccaaab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:26.891427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918ef1a-6d5d-467b-a78a-6bc3d6ccaaab None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:26.903035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 516/1026] 10.222.0.70 () {56 vars in 1251 bytes} [Wed May 18 22:24:26 2022] GET /identity/v3/endpoints?service_id=a96fe5e9912143f1a4bcc3382abe5c87&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:26.903892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbbae1-36fe-461a-a675-f7d0f9dfe554 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:27.009750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbbae1-36fe-461a-a675-f7d0f9dfe554 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:27.047398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17189fcf-f83c-44ca-bc68-8a08e3c21f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:27.048071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189fcf-f83c-44ca-bc68-8a08e3c21f7f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:27.048354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189fcf-f83c-44ca-bc68-8a08e3c21f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:27.048628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189fcf-f83c-44ca-bc68-8a08e3c21f7f None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:27.049311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17189fcf-f83c-44ca-bc68-8a08e3c21f7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:27.050723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17189fcf-f83c-44ca-bc68-8a08e3c21f7f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:27.057910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 511/1027] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:24:26 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:24:27.769625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e974-0795-437e-a696-3adeaf6086f7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:27.770184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e974-0795-437e-a696-3adeaf6086f7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:27.770264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962e974-0795-437e-a696-3adeaf6086f7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:27.771600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 517/1028] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:27.777625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a2f79-f414-43c6-b9e7-71e8ebe7b3eb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:27.778055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a2f79-f414-43c6-b9e7-71e8ebe7b3eb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:27.778283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a2f79-f414-43c6-b9e7-71e8ebe7b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:27.796029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-332a2f79-f414-43c6-b9e7-71e8ebe7b3eb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:27.797218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-332a2f79-f414-43c6-b9e7-71e8ebe7b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:27.838032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:27.864701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 512/1029] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:27.887681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962e974-0795-437e-a696-3adeaf6086f7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:27.915076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:27.995052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962e974-0795-437e-a696-3adeaf6086f7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:28.032079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b4227-7ddd-4647-bf31-2188ed8debf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:28.032812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b4227-7ddd-4647-bf31-2188ed8debf1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:28.033095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b4227-7ddd-4647-bf31-2188ed8debf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:28.033370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b4227-7ddd-4647-bf31-2188ed8debf1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:28.046845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b4227-7ddd-4647-bf31-2188ed8debf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d71b4227-7ddd-4647-bf31-2188ed8debf1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:28.061967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:28.063179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:28.064241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 518/1030] 10.222.0.70 () {56 vars in 1120 bytes} [Wed May 18 22:24:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:28.065122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a2f79-f414-43c6-b9e7-71e8ebe7b3eb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:28.166915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a2f79-f414-43c6-b9e7-71e8ebe7b3eb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:28.202684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:28.203348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:28.203623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:28.203891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:28.204623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:28.204922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:28.206379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:28.219541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 513/1031] 10.222.0.70 () {56 vars in 1115 bytes} [Wed May 18 22:24:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:28.220798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b4227-7ddd-4647-bf31-2188ed8debf1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:28.308994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:28.325071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b4227-7ddd-4647-bf31-2188ed8debf1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:28.359552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:28.360342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:28.360672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:28.360958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:28.371078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:28.372517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:28.391609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:28.392555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:28.398979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:28.398979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:28.398979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:28.398979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:28.398979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 519/1032] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:28.399288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:28.433861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:28.499034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b4f1e-c2ae-4e1b-9387-c853d06be58c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:28.533315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:28.533966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:28.534277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:28.534545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:28.535249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:28.535547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:28.536936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:28.553279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 514/1033] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:28.554571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:28.654451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e454-93ff-46f7-8593-f38785d506a1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:28.688392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:28.689175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:28.689450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:28.689717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:28.692830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:28.698270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:28.699699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:28.714402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:28.715383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:28.716362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 520/1034] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:24:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:28.722667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:28.821091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:28.827934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290b667-994c-4e8c-921d-bf99aea32681 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:28.864296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173bd8d-0fd5-41ed-b14e-58ab5d4e23ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:28.864988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173bd8d-0fd5-41ed-b14e-58ab5d4e23ab None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:28.865267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173bd8d-0fd5-41ed-b14e-58ab5d4e23ab None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:28.865540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173bd8d-0fd5-41ed-b14e-58ab5d4e23ab None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:28.866534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173bd8d-0fd5-41ed-b14e-58ab5d4e23ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:28.867373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173bd8d-0fd5-41ed-b14e-58ab5d4e23ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:28.868539 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173bd8d-0fd5-41ed-b14e-58ab5d4e23ab None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:28.893829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 515/1035] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:24:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:28.895213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.001701 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b47b4-6e60-4d2a-b932-f3c0cb3312a8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:29.049505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12117b2-6f3e-41ad-a593-84a0797e029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:29.050183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12117b2-6f3e-41ad-a593-84a0797e029b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.050464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12117b2-6f3e-41ad-a593-84a0797e029b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.050738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12117b2-6f3e-41ad-a593-84a0797e029b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.053518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76ca74-9b7c-471c-a147-ac562ee8fb7f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.053803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76ca74-9b7c-471c-a147-ac562ee8fb7f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.054165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76ca74-9b7c-471c-a147-ac562ee8fb7f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.058725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 516/1036] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:29.064377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5426a5-d25f-454e-ad0b-b7387ae77adf None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.064665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5426a5-d25f-454e-ad0b-b7387ae77adf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.064939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5426a5-d25f-454e-ad0b-b7387ae77adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.082242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-af5426a5-d25f-454e-ad0b-b7387ae77adf None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:29.083408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-af5426a5-d25f-454e-ad0b-b7387ae77adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:29.126734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:29.136826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12117b2-6f3e-41ad-a593-84a0797e029b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:29.139265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12117b2-6f3e-41ad-a593-84a0797e029b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:29.158913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 517/1037] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:29.184444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5426a5-d25f-454e-ad0b-b7387ae77adf None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.248877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 521/1038] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:28 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:24:29.254322 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12117b2-6f3e-41ad-a593-84a0797e029b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.269438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:29.286595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5426a5-d25f-454e-ad0b-b7387ae77adf None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:29.324849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066357a-30db-46e2-89c0-d3a1f704cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:29.325631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066357a-30db-46e2-89c0-d3a1f704cc4d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.325909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066357a-30db-46e2-89c0-d3a1f704cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.326327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066357a-30db-46e2-89c0-d3a1f704cc4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.327479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066357a-30db-46e2-89c0-d3a1f704cc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:29.328897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066357a-30db-46e2-89c0-d3a1f704cc4d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:29.330527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 518/1039] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:29.331748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3319-1951-44d0-8dba-2c6e3da8479a None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.332026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3319-1951-44d0-8dba-2c6e3da8479a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.332289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3319-1951-44d0-8dba-2c6e3da8479a None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.333632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 519/1040] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:29.336629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe3319-1951-44d0-8dba-2c6e3da8479a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.350518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:29.357236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12117b2-6f3e-41ad-a593-84a0797e029b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:29.391131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c3d70-cadd-4de0-aadf-bbb114cc111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:29.391912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c3d70-cadd-4de0-aadf-bbb114cc111c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.392190 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c3d70-cadd-4de0-aadf-bbb114cc111c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.392459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c3d70-cadd-4de0-aadf-bbb114cc111c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.402772 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c3d70-cadd-4de0-aadf-bbb114cc111c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:29.404197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c3d70-cadd-4de0-aadf-bbb114cc111c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-568c3d70-cadd-4de0-aadf-bbb114cc111c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:29.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:29.422810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:29.423767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:29.423767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:29.423767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:29.423767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:29.423767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 522/1041] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:29.424244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c4f1-9166-4f82-9e61-7ff0bc44c48a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.424467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c4f1-9166-4f82-9e61-7ff0bc44c48a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.424742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c4f1-9166-4f82-9e61-7ff0bc44c48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.438143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe3319-1951-44d0-8dba-2c6e3da8479a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:29.441433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a994c4f1-9166-4f82-9e61-7ff0bc44c48a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:29.442895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a994c4f1-9166-4f82-9e61-7ff0bc44c48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:29.472781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8f361-72fe-47c8-8728-5042f299bdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:29.473429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8f361-72fe-47c8-8728-5042f299bdec None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.473795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8f361-72fe-47c8-8728-5042f299bdec None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.474095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8f361-72fe-47c8-8728-5042f299bdec None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.474800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8f361-72fe-47c8-8728-5042f299bdec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:29.476841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8f361-72fe-47c8-8728-5042f299bdec None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:29.508299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 523/1042] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:29.509092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994c4f1-9166-4f82-9e61-7ff0bc44c48a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.568063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 520/1043] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:24:29 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:24:29.568063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8f361-72fe-47c8-8728-5042f299bdec None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.575250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:29.597808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:29.621835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994c4f1-9166-4f82-9e61-7ff0bc44c48a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:29.661681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:29.662407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.662688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.662958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.664685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:29.664998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:29.666441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:29.678661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8f361-72fe-47c8-8728-5042f299bdec None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:29.684137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 524/1044] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:29.685120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.716827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:29.717621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.717896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.718197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] PATH_INFO: `/v3/services/image` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.718851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:29.720244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:29.733553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:29.734818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:29.739003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 521/1045] 10.222.0.70 () {56 vars in 1105 bytes} [Wed May 18 22:24:29 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:29.743763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.813391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b70dd-4227-4fb1-95b3-f17db89060b2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:29.831981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:29.852179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:29.852998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.853253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.853528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.860641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:29.862112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:29.863076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a4750-17a4-40d5-aa09-95c37217cc94 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:29.863939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:29.877285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:29.878301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:29.879235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 525/1046] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:29.884959 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.902560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:29.903224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:29.903498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:29.903775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:29.904692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:29.904908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:29.906432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:29.916649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 522/1047] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:29.917686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:29.998977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175ca14-9307-4600-b292-245161fc0557 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:30.024362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e3f1d-fbec-48ff-812e-b7137c8110d1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:30.041871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:30.042659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:30.042940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:30.043335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:30.044130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:30.044442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:30.045994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:30.066319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 526/1048] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:30.068420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:30.070228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:30.070837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:30.071112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:30.071380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:30.072113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] RBAC: Adding query filter params (type=image) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:30.074210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:30.075615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:30.077898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:30.083824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 523/1049] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:30.089839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:30.136092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:30.181641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12025785-d028-4f4e-b193-178352d4fafd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:30.218288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40242c3-aec8-462b-b2c8-cc146b177a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:30.218618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40242c3-aec8-462b-b2c8-cc146b177a09 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:30.218896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40242c3-aec8-462b-b2c8-cc146b177a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:30.219173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40242c3-aec8-462b-b2c8-cc146b177a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:30.220002 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40242c3-aec8-462b-b2c8-cc146b177a09 None admin] RBAC: Adding query filter params (role.id=f5bde01204ea4412949dbb02c9e51a32, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=55b3fcbfb08544d482bd0bea4b3d3f0f) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:30.220314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40242c3-aec8-462b-b2c8-cc146b177a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:30.221726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40242c3-aec8-462b-b2c8-cc146b177a09 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:30.234060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 527/1050] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:30 2022] GET /identity/v3/role_assignments?user.id=55b3fcbfb08544d482bd0bea4b3d3f0f&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=f5bde01204ea4412949dbb02c9e51a32 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:30.237262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e928a8-4c90-4152-a8ba-cc5faaa38fae None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:30.278371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faffe2-a052-49d8-8752-75980d685b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:30.279057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faffe2-a052-49d8-8752-75980d685b56 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:30.279339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faffe2-a052-49d8-8752-75980d685b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:30.279615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faffe2-a052-49d8-8752-75980d685b56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:30.280368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faffe2-a052-49d8-8752-75980d685b56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:30.281806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faffe2-a052-49d8-8752-75980d685b56 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:30.342119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 524/1051] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:24:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:24:31.981643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ff8f-a89a-4241-a774-2df261966382 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:31.982226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ff8f-a89a-4241-a774-2df261966382 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:31.982226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78ff8f-a89a-4241-a774-2df261966382 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:31.983692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 528/1052] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:31.988700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638601f-c3e9-491b-b989-34724ea4f37e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:31.989111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638601f-c3e9-491b-b989-34724ea4f37e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:31.989293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638601f-c3e9-491b-b989-34724ea4f37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.005952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8638601f-c3e9-491b-b989-34724ea4f37e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:32.007846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8638601f-c3e9-491b-b989-34724ea4f37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:32.067859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:32.090984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 525/1053] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:32.114436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78ff8f-a89a-4241-a774-2df261966382 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:32.234916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78ff8f-a89a-4241-a774-2df261966382 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:32.258821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:32.270256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8141f7-750d-44a8-ab23-cb642b097616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:32.271256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8141f7-750d-44a8-ab23-cb642b097616 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.271711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8141f7-750d-44a8-ab23-cb642b097616 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.272129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8141f7-750d-44a8-ab23-cb642b097616 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.283767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8141f7-750d-44a8-ab23-cb642b097616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0f8141f7-750d-44a8-ab23-cb642b097616 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:32.292177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:32.293238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:24:32.294128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:32.298142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 529/1054] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:32.300223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638601f-c3e9-491b-b989-34724ea4f37e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:32.405428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638601f-c3e9-491b-b989-34724ea4f37e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:32.439510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325728b7-3d91-4301-af9e-2b3310addfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:32.440174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325728b7-3d91-4301-af9e-2b3310addfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.440452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325728b7-3d91-4301-af9e-2b3310addfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.440720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325728b7-3d91-4301-af9e-2b3310addfa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.441459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325728b7-3d91-4301-af9e-2b3310addfa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:32.441761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325728b7-3d91-4301-af9e-2b3310addfa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:32.443433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325728b7-3d91-4301-af9e-2b3310addfa0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:32.457268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 526/1055] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:32.458722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8141f7-750d-44a8-ab23-cb642b097616 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:32.555377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6e64-13a4-4ead-9906-1d2131602b41 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.555558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6e64-13a4-4ead-9906-1d2131602b41 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.555807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6e64-13a4-4ead-9906-1d2131602b41 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.557302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 527/1056] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:32.562130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea32f2-ee46-4243-a1cb-bcdc33d3817f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.562418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea32f2-ee46-4243-a1cb-bcdc33d3817f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.562692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea32f2-ee46-4243-a1cb-bcdc33d3817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.565804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8141f7-750d-44a8-ab23-cb642b097616 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:32.580139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-efea32f2-ee46-4243-a1cb-bcdc33d3817f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:32.581303 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-efea32f2-ee46-4243-a1cb-bcdc33d3817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:32.602401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942e18-7476-4bc9-8ad1-52882c6f1783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:32.603267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942e18-7476-4bc9-8ad1-52882c6f1783 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.603540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942e18-7476-4bc9-8ad1-52882c6f1783 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.603824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16942e18-7476-4bc9-8ad1-52882c6f1783 None admin] PATH_INFO: `/v3/users/ec4e705105874ab8b61aa04df8784939` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.618298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16942e18-7476-4bc9-8ad1-52882c6f1783 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4e705105874ab8b61aa04df8784939)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:32.619716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16942e18-7476-4bc9-8ad1-52882c6f1783 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:32.621539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 530/1057] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:32 2022] GET /identity/v3/users/ec4e705105874ab8b61aa04df8784939 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:32.626777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942e18-7476-4bc9-8ad1-52882c6f1783 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:32.630021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:32.657209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 528/1058] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:32.668511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26adcb-6daa-47ac-9ae1-8699d4f807c6 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.668795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26adcb-6daa-47ac-9ae1-8699d4f807c6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.669067 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26adcb-6daa-47ac-9ae1-8699d4f807c6 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.670982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 529/1059] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:32.672141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:32.675716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2274-77d4-47ed-b907-ce8b47f7aa32 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.675989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2274-77d4-47ed-b907-ce8b47f7aa32 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.676256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2274-77d4-47ed-b907-ce8b47f7aa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.693423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-971a2274-77d4-47ed-b907-ce8b47f7aa32 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:32.694654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-971a2274-77d4-47ed-b907-ce8b47f7aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:32.732491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16942e18-7476-4bc9-8ad1-52882c6f1783 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:32.763305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 530/1060] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:32.766860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2274-77d4-47ed-b907-ce8b47f7aa32 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:32.767914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9f223-98cd-411c-b3ad-e9dbaa5905cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:32.768561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9f223-98cd-411c-b3ad-e9dbaa5905cc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.768844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9f223-98cd-411c-b3ad-e9dbaa5905cc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.769124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9f223-98cd-411c-b3ad-e9dbaa5905cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.838700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9f223-98cd-411c-b3ad-e9dbaa5905cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:32.840065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9f223-98cd-411c-b3ad-e9dbaa5905cc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:32.869489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2274-77d4-47ed-b907-ce8b47f7aa32 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:32.871934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:32.886640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:32.903652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cdd0d-57ce-4ed4-afbc-733b936bc27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:32.904454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cdd0d-57ce-4ed4-afbc-733b936bc27d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:32.904731 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cdd0d-57ce-4ed4-afbc-733b936bc27d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:32.905000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cdd0d-57ce-4ed4-afbc-733b936bc27d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:32.915861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cdd0d-57ce-4ed4-afbc-733b936bc27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9c6cdd0d-57ce-4ed4-afbc-733b936bc27d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:32.924190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:32.925171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:32.926091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 531/1061] 10.222.0.70 () {56 vars in 1120 bytes} [Wed May 18 22:24:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:32.926840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cdd0d-57ce-4ed4-afbc-733b936bc27d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:32.951713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 531/1062] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 22:24:32.951713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9f223-98cd-411c-b3ad-e9dbaa5905cc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.028366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cdd0d-57ce-4ed4-afbc-733b936bc27d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.056648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9f223-98cd-411c-b3ad-e9dbaa5905cc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.062867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c27ca-ade9-4de9-8990-54dcb8901a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.063512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c27ca-ade9-4de9-8990-54dcb8901a49 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.063795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c27ca-ade9-4de9-8990-54dcb8901a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.064071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c27ca-ade9-4de9-8990-54dcb8901a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.091783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.092373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.092653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.092926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.093701 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:33.094026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.095381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.096026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:33.104678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 532/1063] 10.222.0.70 () {56 vars in 1115 bytes} [Wed May 18 22:24:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:33.105466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.108095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:33.133892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c27ca-ade9-4de9-8990-54dcb8901a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.135364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c27ca-ade9-4de9-8990-54dcb8901a49 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.252349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978852f9-fe64-4c58-9a55-5e3c7dca6a8e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.285500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7fae-0f3b-452d-a1a2-d08363e30a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.286377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7fae-0f3b-452d-a1a2-d08363e30a04 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.286661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7fae-0f3b-452d-a1a2-d08363e30a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.286936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7fae-0f3b-452d-a1a2-d08363e30a04 None admin] PATH_INFO: `/v3/projects/5b5990253fc843afb087f1361687b9e6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.287484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 532/1064] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:24:33.288348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7fae-0f3b-452d-a1a2-d08363e30a04 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5990253fc843afb087f1361687b9e6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.288967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c27ca-ade9-4de9-8990-54dcb8901a49 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.290854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7fae-0f3b-452d-a1a2-d08363e30a04 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.292721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 533/1065] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:24:33 2022] GET /identity/v3/projects/5b5990253fc843afb087f1361687b9e6 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:33.293928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7fae-0f3b-452d-a1a2-d08363e30a04 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.351377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:33.363169 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:33.388028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c27ca-ade9-4de9-8990-54dcb8901a49 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.393592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7fae-0f3b-452d-a1a2-d08363e30a04 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.421039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.421822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.422126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.422397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.427247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.428021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.428297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.428566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.432980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.434462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.438935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.440352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:33.451943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:33.452961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:33.453923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:33.453923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:33.453923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:33.453923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:33.457780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:33.458768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:33.460027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:33.460027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:33.460027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:33.460027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:33.461745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 533/1066] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:33.461745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.462058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 534/1067] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:33.462058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.558212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46155fd0-b600-4b06-af3a-8c80903470da None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.559169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619f01-f087-459c-9d05-7b270f630530 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.576039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:33.580409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:33.592522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.593386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.593662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.593932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.594065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.594597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.594691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:33.594877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.594979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.595152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.595977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=5b5990253fc843afb087f1361687b9e6, user.id=ec4e705105874ab8b61aa04df8784939) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:33.596286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.596377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.597706 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.603439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 534/1068] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:33 2022] GET /identity/v3/role_assignments?user.id=ec4e705105874ab8b61aa04df8784939&scope.project.id=5b5990253fc843afb087f1361687b9e6&role.id=fe643140d2134736a54afd972d47d43f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:33.604049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.610246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 535/1069] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:33.614804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.721712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008999d-e5aa-4d9e-9197-1cbe3d0e6013 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.735204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c77f5-5d07-4684-800e-6a17de513ca2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.760049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.760718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.760998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.761270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.761988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:33.762323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.763731 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.773974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.774811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.775094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.775364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.785380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 535/1070] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:33.792579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.794114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:33.810505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:33.811543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:33.813775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 536/1071] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:24:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:33.820198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:33.870825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:33.934391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a374e0f-db85-4d1c-87b2-3f961c4c2f39 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:33.972444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:33.973831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:33.973831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:33.973831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:33.974492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:33.974798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:33.976477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:33.998061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 536/1072] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:24:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:34.003967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:34.059541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:34.119587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce7e4c-cbe6-4425-bcb0-0490a404b274 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:34.154227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:34.155013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:34.155292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:34.155563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:34.166071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:34.167502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:34.185419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:34.186541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:34.187603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:34.187603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:34.187603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:34.187603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:34.188165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 537/1073] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:34.192214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:34.286224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:34.290169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6e51-1c3f-4b56-baa3-54a92f2e5d11 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:34.324186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:34.324839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:34.325118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:34.325389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:34.326126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:34.326431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:34.327798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:34.339436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 537/1074] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:34.344923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:34.436867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:34.443485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ce71a-f2f3-4b6f-9db5-851fa0d98338 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:34.477649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:34.478455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:34.478732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:34.478997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:34.485388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:34.486833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:34.500702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:34.501623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:34.502748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 538/1075] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:34.507708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:34.605674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa835b-95e4-430c-9d33-d075c3ebc074 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:34.637438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3dbba-1c92-414f-8ceb-434f98e683aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:34.638102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3dbba-1c92-414f-8ceb-434f98e683aa None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:34.638381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3dbba-1c92-414f-8ceb-434f98e683aa None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:34.638652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3dbba-1c92-414f-8ceb-434f98e683aa None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:34.639424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3dbba-1c92-414f-8ceb-434f98e683aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:34.639729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3dbba-1c92-414f-8ceb-434f98e683aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:34.641145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3dbba-1c92-414f-8ceb-434f98e683aa None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:34.653428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 538/1076] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:34.659199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:34.760328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc843a-345b-488e-8f60-1d6c8b69f21d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:34.800321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704427ca-b24c-406c-a56d-db62e6f14e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:34.801209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704427ca-b24c-406c-a56d-db62e6f14e2e None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:34.801496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704427ca-b24c-406c-a56d-db62e6f14e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:34.801770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704427ca-b24c-406c-a56d-db62e6f14e2e None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/55b3fcbfb08544d482bd0bea4b3d3f0f/roles/f5bde01204ea4412949dbb02c9e51a32` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:34.803970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704427ca-b24c-406c-a56d-db62e6f14e2e None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=55b3fcbfb08544d482bd0bea4b3d3f0f, role_id=f5bde01204ea4412949dbb02c9e51a32)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:34.805392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704427ca-b24c-406c-a56d-db62e6f14e2e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:34.896722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 539/1077] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:24:34 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/55b3fcbfb08544d482bd0bea4b3d3f0f/roles/f5bde01204ea4412949dbb02c9e51a32 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:24:35.849841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71e308-9042-497f-a679-489379d434fe None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:35.850447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71e308-9042-497f-a679-489379d434fe None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:35.850447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71e308-9042-497f-a679-489379d434fe None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:35.852392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 539/1078] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:35.857617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d55e8-b05a-4cc9-961b-d36233e71773 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:35.858059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d55e8-b05a-4cc9-961b-d36233e71773 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:35.858202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d55e8-b05a-4cc9-961b-d36233e71773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:35.875385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cb2d55e8-b05a-4cc9-961b-d36233e71773 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:35.876563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cb2d55e8-b05a-4cc9-961b-d36233e71773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:35.885770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:35.943328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 540/1079] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:35.965975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71e308-9042-497f-a679-489379d434fe None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:35.985551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:36.071661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71e308-9042-497f-a679-489379d434fe None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:36.107754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a0b82-61ef-4ead-b783-1c097bcdb9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:36.108546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a0b82-61ef-4ead-b783-1c097bcdb9af None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:36.108817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a0b82-61ef-4ead-b783-1c097bcdb9af None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:36.109083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a0b82-61ef-4ead-b783-1c097bcdb9af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:36.119297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a0b82-61ef-4ead-b783-1c097bcdb9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0d0a0b82-61ef-4ead-b783-1c097bcdb9af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:36.127025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:36.132880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:36.134061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 540/1080] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:36.134802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d55e8-b05a-4cc9-961b-d36233e71773 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:36.232896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d55e8-b05a-4cc9-961b-d36233e71773 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:36.265778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:36.266458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:36.266740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:36.267013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:36.267754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:36.268057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:36.269406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:36.277808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 541/1081] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:24:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:36.283631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a0b82-61ef-4ead-b783-1c097bcdb9af None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:36.360679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:36.381038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a0b82-61ef-4ead-b783-1c097bcdb9af None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:36.415090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3423bbf-f268-4bc4-b335-118d8d0b0c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:36.415958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423bbf-f268-4bc4-b335-118d8d0b0c87 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:36.416241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423bbf-f268-4bc4-b335-118d8d0b0c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:36.416514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3423bbf-f268-4bc4-b335-118d8d0b0c87 None admin] PATH_INFO: `/v3/users/ec4e705105874ab8b61aa04df8784939` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:36.417690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3423bbf-f268-4bc4-b335-118d8d0b0c87 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4e705105874ab8b61aa04df8784939)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:36.419149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3423bbf-f268-4bc4-b335-118d8d0b0c87 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:36.420996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 541/1082] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:36 2022] GET /identity/v3/users/ec4e705105874ab8b61aa04df8784939 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:36.426480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:36.435905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:36.526732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5edc4-c583-4c0a-8dbd-57d5e574a51f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:36.563215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52264b29-f5a1-43f9-9bb1-4112a7f08da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:36.564070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52264b29-f5a1-43f9-9bb1-4112a7f08da9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:36.564351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52264b29-f5a1-43f9-9bb1-4112a7f08da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:36.564656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52264b29-f5a1-43f9-9bb1-4112a7f08da9 None admin] PATH_INFO: `/v3/projects/5b5990253fc843afb087f1361687b9e6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:36.565869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52264b29-f5a1-43f9-9bb1-4112a7f08da9 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5990253fc843afb087f1361687b9e6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:36.567323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52264b29-f5a1-43f9-9bb1-4112a7f08da9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:36.569281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 542/1083] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:24:36 2022] GET /identity/v3/projects/5b5990253fc843afb087f1361687b9e6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:36.575661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3423bbf-f268-4bc4-b335-118d8d0b0c87 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:36.673701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3423bbf-f268-4bc4-b335-118d8d0b0c87 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:36.706723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780252b1-4f56-485a-9904-cf576aeb5100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:36.707601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780252b1-4f56-485a-9904-cf576aeb5100 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:36.707877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780252b1-4f56-485a-9904-cf576aeb5100 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:36.708146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780252b1-4f56-485a-9904-cf576aeb5100 None admin] PATH_INFO: `/v3/projects/5b5990253fc843afb087f1361687b9e6/users/ec4e705105874ab8b61aa04df8784939/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:36.710718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780252b1-4f56-485a-9904-cf576aeb5100 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5990253fc843afb087f1361687b9e6, user_id=ec4e705105874ab8b61aa04df8784939, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:36.712104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780252b1-4f56-485a-9904-cf576aeb5100 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:36.767036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 542/1084] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:24:36 2022] PUT /identity/v3/projects/5b5990253fc843afb087f1361687b9e6/users/ec4e705105874ab8b61aa04df8784939/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:24:37.094196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72753d6-76ed-4482-8e2a-e3e48b8425a9 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:37.094714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72753d6-76ed-4482-8e2a-e3e48b8425a9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:37.094714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72753d6-76ed-4482-8e2a-e3e48b8425a9 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:37.096224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 543/1085] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:37.101928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a0d7a-fdc2-40f2-b3fe-20b99b56a5d2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:37.105644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a0d7a-fdc2-40f2-b3fe-20b99b56a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:37.105644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a0d7a-fdc2-40f2-b3fe-20b99b56a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:37.115100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:37.121180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5a5a0d7a-fdc2-40f2-b3fe-20b99b56a5d2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:37.123013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5a5a0d7a-fdc2-40f2-b3fe-20b99b56a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:37.189714 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 543/1086] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:37.213812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72753d6-76ed-4482-8e2a-e3e48b8425a9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:37.287680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:37.313898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72753d6-76ed-4482-8e2a-e3e48b8425a9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:37.347722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce94e08-0b3d-4249-8c88-23a19ab5aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:37.348520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94e08-0b3d-4249-8c88-23a19ab5aa13 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:37.348799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94e08-0b3d-4249-8c88-23a19ab5aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:37.349069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce94e08-0b3d-4249-8c88-23a19ab5aa13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:37.359199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce94e08-0b3d-4249-8c88-23a19ab5aa13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-3ce94e08-0b3d-4249-8c88-23a19ab5aa13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:37.367634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:37.368858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 22:24:37.369849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:37.373715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 544/1087] 10.222.0.70 () {56 vars in 1120 bytes} [Wed May 18 22:24:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:37.374678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a0d7a-fdc2-40f2-b3fe-20b99b56a5d2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:37.473117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a0d7a-fdc2-40f2-b3fe-20b99b56a5d2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:37.506664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:37.508128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:37.508431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:37.508701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:37.509440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:37.509743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:37.511144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:37.513343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:37.519543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 544/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Wed May 18 22:24:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:37.525350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce94e08-0b3d-4249-8c88-23a19ab5aa13 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:37.624396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce94e08-0b3d-4249-8c88-23a19ab5aa13 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:37.658576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:37.659352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:37.659631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:37.659902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:37.661750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:37.670669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:37.675602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:37.689325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:37.690359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:37.691312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:37.691312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:37.691312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:37.691312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:37.691312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 545/1089] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:37.696894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:37.793308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a6b7-8241-4d9a-a031-1bbc017194a3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:37.826869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:37.827516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:37.827795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:37.828071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:37.828777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:37.829079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:37.830536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:37.842406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 545/1090] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:37.848091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:37.948279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b401a1-c853-42e1-9eba-d79457756f6d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:37.980607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:37.981383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:37.981656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:37.981922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:37.989276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:37.990714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:24:38.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:38.005902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 22:24:38.007130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:24:38.010160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 546/1091] 10.222.0.70 () {56 vars in 1093 bytes} [Wed May 18 22:24:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:38.011638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:38.071210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:38.113265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290ef9b-980c-42d2-b8ce-4721acf0db23 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:38.147996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:38.148736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:38.150201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:38.150201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:38.150201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:38.150645 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:38.151913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:38.169166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 546/1092] 10.222.0.70 () {56 vars in 1133 bytes} [Wed May 18 22:24:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:38.174883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:38.222270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:38.274936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae495cc-377f-4431-885d-f4f9edd314c3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:38.307583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a2bf3-b930-48a7-b16b-d4eab9b3460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:38.308209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2bf3-b930-48a7-b16b-d4eab9b3460d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:38.308487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2bf3-b930-48a7-b16b-d4eab9b3460d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:38.308758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a2bf3-b930-48a7-b16b-d4eab9b3460d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:38.373343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a2bf3-b930-48a7-b16b-d4eab9b3460d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:38.374784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a2bf3-b930-48a7-b16b-d4eab9b3460d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:38.417738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:38.471596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 547/1093] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:24:38.477299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:38.574874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735896-ebc4-4529-af95-1239bd9606af None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:38.590961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:38.608713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:38.609500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:38.609778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:38.610076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:38.620732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:38.622199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:24:38.640493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:38.641638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:38.643061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:24:38.643061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:24:38.643061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:24:38.643061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:38.643061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 547/1094] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:38.647273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a2bf3-b930-48a7-b16b-d4eab9b3460d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:38.745213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a2bf3-b930-48a7-b16b-d4eab9b3460d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:38.777712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:38.778396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:38.778679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:38.778954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:38.779665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:38.779969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:38.781338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:38.793503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 548/1095] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:38.799284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:38.900183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4fb2-7c2f-48ba-9c1a-fa12cb98678e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:38.933593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54ac92-d5ee-4249-aa2b-9103130d329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:38.934402 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ac92-d5ee-4249-aa2b-9103130d329b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:38.934675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ac92-d5ee-4249-aa2b-9103130d329b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:38.934939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54ac92-d5ee-4249-aa2b-9103130d329b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:38.941463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54ac92-d5ee-4249-aa2b-9103130d329b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:38.943197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54ac92-d5ee-4249-aa2b-9103130d329b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-3f54ac92-d5ee-4249-aa2b-9103130d329b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:24:38.956596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:38.957535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:38.958920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 548/1096] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:24:38.963571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:38.972720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:38.987842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64def-f360-479c-ab26-282a5269375e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:38.988642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64def-f360-479c-ab26-282a5269375e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:38.988642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d64def-f360-479c-ab26-282a5269375e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:38.989862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 549/1097] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:38.995290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465730-fa1e-4c28-9a31-3fb511c2dc20 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:38.995521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465730-fa1e-4c28-9a31-3fb511c2dc20 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:38.995799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465730-fa1e-4c28-9a31-3fb511c2dc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:39.012513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-21465730-fa1e-4c28-9a31-3fb511c2dc20 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:39.013695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-21465730-fa1e-4c28-9a31-3fb511c2dc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:39.040970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:39.074642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102813f7-2592-44ff-86a0-188a6ac0066e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:39.085706 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 550/1098] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:24:39.108423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:39.109084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:39.109361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:39.109634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:39.109750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465730-fa1e-4c28-9a31-3fb511c2dc20 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:39.110455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:39.110761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:39.112169 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:39.124451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 549/1099] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:39.130633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:39.194851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:39.206016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465730-fa1e-4c28-9a31-3fb511c2dc20 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:39.230671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59021b06-8a9f-4e0f-92ce-e143cc998ea4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:39.239562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6ca92-e375-4277-bba9-f473b7511a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:39.240339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ca92-e375-4277-bba9-f473b7511a4c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:39.240615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ca92-e375-4277-bba9-f473b7511a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:39.240882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ca92-e375-4277-bba9-f473b7511a4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:39.250679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6ca92-e375-4277-bba9-f473b7511a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-72f6ca92-e375-4277-bba9-f473b7511a4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:24:39.258185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:24:39.259225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:24:39.260091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:24:39.262145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 551/1100] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:24:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:24:39.264263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:39.264907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:39.265159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6ca92-e375-4277-bba9-f473b7511a4c None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:39.265270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:39.265443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:39.266299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] RBAC: Adding query filter params (role.id=f5bde01204ea4412949dbb02c9e51a32, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=55b3fcbfb08544d482bd0bea4b3d3f0f) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:39.266609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:39.268029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:39.283644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 550/1101] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:39 2022] GET /identity/v3/role_assignments?user.id=55b3fcbfb08544d482bd0bea4b3d3f0f&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=f5bde01204ea4412949dbb02c9e51a32 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:39.284695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:39.372291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6ca92-e375-4277-bba9-f473b7511a4c None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:39.407374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:39.408043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:39.408319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:39.408590 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:39.409344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:39.409648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:39.411086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:39.420766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 552/1102] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:24:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:39.426696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:39.529413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4203d-439f-42e5-9b34-fb90abe4bf2f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:39.559360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:39.564876 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567057-f8e6-4756-8585-0b316bf040cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:39.565766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567057-f8e6-4756-8585-0b316bf040cb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:39.566115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567057-f8e6-4756-8585-0b316bf040cb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:39.566332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04567057-f8e6-4756-8585-0b316bf040cb None admin] PATH_INFO: `/v3/users/ec4e705105874ab8b61aa04df8784939` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:39.567761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04567057-f8e6-4756-8585-0b316bf040cb None admin] RBAC: Authorizing `identity:get_user(user_id=ec4e705105874ab8b61aa04df8784939)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:39.569179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04567057-f8e6-4756-8585-0b316bf040cb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:39.571036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 551/1103] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:39 2022] GET /identity/v3/users/ec4e705105874ab8b61aa04df8784939 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:39.576966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:39.660158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:39.679661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40d31-7a60-4396-9548-2b5062ff7edf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:39.715537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bf0f-b7df-4139-85fc-4e0f79edf1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:39.716179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bf0f-b7df-4139-85fc-4e0f79edf1cb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:39.716453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bf0f-b7df-4139-85fc-4e0f79edf1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:39.716729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3bf0f-b7df-4139-85fc-4e0f79edf1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:39.785822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3bf0f-b7df-4139-85fc-4e0f79edf1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:39.787242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3bf0f-b7df-4139-85fc-4e0f79edf1cb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:39.868695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:39.889209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 553/1104] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:24:39.895231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567057-f8e6-4756-8585-0b316bf040cb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:39.998076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04567057-f8e6-4756-8585-0b316bf040cb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:40.032071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6fde5-f324-49f5-8679-5b425666ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:40.032922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fde5-f324-49f5-8679-5b425666ffec None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:40.033199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fde5-f324-49f5-8679-5b425666ffec None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:40.033471 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6fde5-f324-49f5-8679-5b425666ffec None admin] PATH_INFO: `/v3/projects/5b5990253fc843afb087f1361687b9e6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:40.034649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6fde5-f324-49f5-8679-5b425666ffec None admin] RBAC: Authorizing `identity:get_project(project_id=5b5990253fc843afb087f1361687b9e6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:40.036122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6fde5-f324-49f5-8679-5b425666ffec None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:40.037920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 552/1105] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:24:39 2022] GET /identity/v3/projects/5b5990253fc843afb087f1361687b9e6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:40.044066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bf0f-b7df-4139-85fc-4e0f79edf1cb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:40.149087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3bf0f-b7df-4139-85fc-4e0f79edf1cb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:40.184030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a427d84-ffb5-4584-a86d-2792e5f099ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:40.184677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427d84-ffb5-4584-a86d-2792e5f099ab None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:40.184960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427d84-ffb5-4584-a86d-2792e5f099ab None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:40.185236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427d84-ffb5-4584-a86d-2792e5f099ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:40.186092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a427d84-ffb5-4584-a86d-2792e5f099ab None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=5b5990253fc843afb087f1361687b9e6, user.id=ec4e705105874ab8b61aa04df8784939) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:40.186404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a427d84-ffb5-4584-a86d-2792e5f099ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:40.187858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a427d84-ffb5-4584-a86d-2792e5f099ab None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:40.193860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 554/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:40 2022] GET /identity/v3/role_assignments?user.id=ec4e705105874ab8b61aa04df8784939&scope.project.id=5b5990253fc843afb087f1361687b9e6&role.id=fe643140d2134736a54afd972d47d43f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:42.462762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46317c-0f32-472e-9f6e-6ef85fd1e8d4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:42.463314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46317c-0f32-472e-9f6e-6ef85fd1e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:42.463314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46317c-0f32-472e-9f6e-6ef85fd1e8d4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:42.464642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 553/1107] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:24:42.469909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28d75-5524-45bb-8ed8-386cd30e99f5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:42.470371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28d75-5524-45bb-8ed8-386cd30e99f5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:42.470464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a28d75-5524-45bb-8ed8-386cd30e99f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:42.486872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-33a28d75-5524-45bb-8ed8-386cd30e99f5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:42.488028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-33a28d75-5524-45bb-8ed8-386cd30e99f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:42.527146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:42.552355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 555/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:42.577267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46317c-0f32-472e-9f6e-6ef85fd1e8d4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:42.642254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:42.676613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46317c-0f32-472e-9f6e-6ef85fd1e8d4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:42.708947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8028c-7dfa-4999-8168-5e1dadbb26d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:42.709714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8028c-7dfa-4999-8168-5e1dadbb26d4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:42.710557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8028c-7dfa-4999-8168-5e1dadbb26d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:42.710828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8028c-7dfa-4999-8168-5e1dadbb26d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:42.711977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8028c-7dfa-4999-8168-5e1dadbb26d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:42.713439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8028c-7dfa-4999-8168-5e1dadbb26d4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:42.714994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 554/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:42.720619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28d75-5524-45bb-8ed8-386cd30e99f5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:42.815452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a28d75-5524-45bb-8ed8-386cd30e99f5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:42.848806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f6dbc-8e23-4bdf-8130-47f37f86502a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:42.849459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f6dbc-8e23-4bdf-8130-47f37f86502a None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:42.849737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f6dbc-8e23-4bdf-8130-47f37f86502a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:42.850032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f6dbc-8e23-4bdf-8130-47f37f86502a None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:42.851012 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f6dbc-8e23-4bdf-8130-47f37f86502a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:42.852415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f6dbc-8e23-4bdf-8130-47f37f86502a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:42.926073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 556/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:24:42 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:45.155352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63bf29-6c34-421a-b803-fa959ec03107 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:45.155962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63bf29-6c34-421a-b803-fa959ec03107 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:45.155962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63bf29-6c34-421a-b803-fa959ec03107 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:45.157293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 555/1111] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:45.162437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce1fc-2caf-4cbd-94b1-8274ed38d891 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:45.162814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce1fc-2caf-4cbd-94b1-8274ed38d891 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:45.163080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce1fc-2caf-4cbd-94b1-8274ed38d891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:45.179975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ebfce1fc-2caf-4cbd-94b1-8274ed38d891 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:45.181140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ebfce1fc-2caf-4cbd-94b1-8274ed38d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:45.203709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:45.245272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 557/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:45.267859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63bf29-6c34-421a-b803-fa959ec03107 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:45.369100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63bf29-6c34-421a-b803-fa959ec03107 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:45.403432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bb4f9-fbb3-4e3e-81ed-64e11f766f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:45.404269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bb4f9-fbb3-4e3e-81ed-64e11f766f84 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:45.404548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bb4f9-fbb3-4e3e-81ed-64e11f766f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:45.404818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bb4f9-fbb3-4e3e-81ed-64e11f766f84 None admin] PATH_INFO: `/v3/roles/6fa4573097ea4494b215fa0be868f8cd` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:45.406293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bb4f9-fbb3-4e3e-81ed-64e11f766f84 None admin] RBAC: Authorizing `identity:get_role(role_id=6fa4573097ea4494b215fa0be868f8cd)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:45.407641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bb4f9-fbb3-4e3e-81ed-64e11f766f84 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:45.408997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 556/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:45 2022] GET /identity/v3/roles/6fa4573097ea4494b215fa0be868f8cd => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:45.414866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce1fc-2caf-4cbd-94b1-8274ed38d891 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:45.508469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce1fc-2caf-4cbd-94b1-8274ed38d891 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:45.541683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9b03-3373-47fd-88f9-e5358224961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:45.542551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9b03-3373-47fd-88f9-e5358224961b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:45.542826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9b03-3373-47fd-88f9-e5358224961b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:45.543095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9b03-3373-47fd-88f9-e5358224961b None admin] PATH_INFO: `/v3/users/79b8cf4ccfda4e26a5c421acc6b113e8` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:45.556028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce9b03-3373-47fd-88f9-e5358224961b None admin] RBAC: Authorizing `identity:get_user(user_id=79b8cf4ccfda4e26a5c421acc6b113e8)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:45.557473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce9b03-3373-47fd-88f9-e5358224961b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:45.559138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 558/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:45 2022] GET /identity/v3/users/79b8cf4ccfda4e26a5c421acc6b113e8 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:45.564649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bb4f9-fbb3-4e3e-81ed-64e11f766f84 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:45.567728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:45.662434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bb4f9-fbb3-4e3e-81ed-64e11f766f84 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:45.695136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a9840-1afe-438b-8254-4e3fe6bb8219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:45.696496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a9840-1afe-438b-8254-4e3fe6bb8219 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:45.696795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a9840-1afe-438b-8254-4e3fe6bb8219 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:45.697072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a9840-1afe-438b-8254-4e3fe6bb8219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:45.762378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a9840-1afe-438b-8254-4e3fe6bb8219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:45.763789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a9840-1afe-438b-8254-4e3fe6bb8219 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:45.765518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:45.859081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 557/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:24:45.864808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9b03-3373-47fd-88f9-e5358224961b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:45.883136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:45.960480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9b03-3373-47fd-88f9-e5358224961b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:45.993401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7ae4b-cab4-4d3c-8684-3bb96c4bb08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:45.994261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7ae4b-cab4-4d3c-8684-3bb96c4bb08c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:45.994532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7ae4b-cab4-4d3c-8684-3bb96c4bb08c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:45.994797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7ae4b-cab4-4d3c-8684-3bb96c4bb08c None admin] PATH_INFO: `/v3/projects/5b5990253fc843afb087f1361687b9e6` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:45.995944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7ae4b-cab4-4d3c-8684-3bb96c4bb08c None admin] RBAC: Authorizing `identity:get_project(project_id=5b5990253fc843afb087f1361687b9e6)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:45.997346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7ae4b-cab4-4d3c-8684-3bb96c4bb08c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:45.999043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 559/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:24:45 2022] GET /identity/v3/projects/5b5990253fc843afb087f1361687b9e6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:46.004978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a9840-1afe-438b-8254-4e3fe6bb8219 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:46.101538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a9840-1afe-438b-8254-4e3fe6bb8219 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:46.103116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:46.134135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36794b25-64da-4b9f-a809-aff529bc6655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:46.134761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794b25-64da-4b9f-a809-aff529bc6655 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:46.135038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794b25-64da-4b9f-a809-aff529bc6655 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:46.135308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794b25-64da-4b9f-a809-aff529bc6655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:46.136121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36794b25-64da-4b9f-a809-aff529bc6655 None admin] RBAC: Adding query filter params (role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=5b5990253fc843afb087f1361687b9e6, user.id=79b8cf4ccfda4e26a5c421acc6b113e8) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:46.136427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36794b25-64da-4b9f-a809-aff529bc6655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:46.137823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36794b25-64da-4b9f-a809-aff529bc6655 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:46.143042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 558/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:46 2022] GET /identity/v3/role_assignments?user.id=79b8cf4ccfda4e26a5c421acc6b113e8&scope.project.id=5b5990253fc843afb087f1361687b9e6&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:48.321788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60fbe-a6c7-4bf2-96c4-a734b5485c05 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:48.322331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60fbe-a6c7-4bf2-96c4-a734b5485c05 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:48.322331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb60fbe-a6c7-4bf2-96c4-a734b5485c05 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:48.323661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 560/1118] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:48.328783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7a5b-301b-49c7-beb1-9fba83a92092 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:48.329180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7a5b-301b-49c7-beb1-9fba83a92092 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:48.329344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef7a5b-301b-49c7-beb1-9fba83a92092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:48.345762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-34ef7a5b-301b-49c7-beb1-9fba83a92092 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:48.346966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-34ef7a5b-301b-49c7-beb1-9fba83a92092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:48.411649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 559/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:48.435237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb60fbe-a6c7-4bf2-96c4-a734b5485c05 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:48.518756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:48.533783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb60fbe-a6c7-4bf2-96c4-a734b5485c05 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:48.567793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e2738-d995-4377-9ddc-7f2ceaa4c688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:48.568631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2738-d995-4377-9ddc-7f2ceaa4c688 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:48.568914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2738-d995-4377-9ddc-7f2ceaa4c688 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:48.569190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2738-d995-4377-9ddc-7f2ceaa4c688 None admin] PATH_INFO: `/v3/roles/6fa4573097ea4494b215fa0be868f8cd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:48.570856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2738-d995-4377-9ddc-7f2ceaa4c688 None admin] RBAC: Authorizing `identity:get_role(role_id=6fa4573097ea4494b215fa0be868f8cd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:48.572233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2738-d995-4377-9ddc-7f2ceaa4c688 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:48.573549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 561/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:48 2022] GET /identity/v3/roles/6fa4573097ea4494b215fa0be868f8cd => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:48.579225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7a5b-301b-49c7-beb1-9fba83a92092 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:48.667879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:48.673366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef7a5b-301b-49c7-beb1-9fba83a92092 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:48.706430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b826-0cf1-42a1-a399-408966e8f011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:48.707275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b826-0cf1-42a1-a399-408966e8f011 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:48.707553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b826-0cf1-42a1-a399-408966e8f011 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:48.707822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b826-0cf1-42a1-a399-408966e8f011 None admin] PATH_INFO: `/v3/users/79b8cf4ccfda4e26a5c421acc6b113e8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:48.708988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799b826-0cf1-42a1-a399-408966e8f011 None admin] RBAC: Authorizing `identity:get_user(user_id=79b8cf4ccfda4e26a5c421acc6b113e8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:48.710445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799b826-0cf1-42a1-a399-408966e8f011 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:48.712557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 560/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:48 2022] GET /identity/v3/users/79b8cf4ccfda4e26a5c421acc6b113e8 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:48.718251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e2738-d995-4377-9ddc-7f2ceaa4c688 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:48.814432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e2738-d995-4377-9ddc-7f2ceaa4c688 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:48.854851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e25d4-083e-4297-9376-907184aa0e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:48.855639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e25d4-083e-4297-9376-907184aa0e60 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:48.855924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e25d4-083e-4297-9376-907184aa0e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:48.856199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e25d4-083e-4297-9376-907184aa0e60 None admin] PATH_INFO: `/v3/projects/5b5990253fc843afb087f1361687b9e6` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:48.857356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e25d4-083e-4297-9376-907184aa0e60 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5990253fc843afb087f1361687b9e6)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:48.858810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e25d4-083e-4297-9376-907184aa0e60 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:48.860498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 562/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:24:48 2022] GET /identity/v3/projects/5b5990253fc843afb087f1361687b9e6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:48.866312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b826-0cf1-42a1-a399-408966e8f011 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:48.963070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b826-0cf1-42a1-a399-408966e8f011 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:48.995831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7346b4b-3a61-4060-9916-c20cafe9771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:48.996699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7346b4b-3a61-4060-9916-c20cafe9771d None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:48.996982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7346b4b-3a61-4060-9916-c20cafe9771d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:48.997257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7346b4b-3a61-4060-9916-c20cafe9771d None admin] PATH_INFO: `/v3/projects/5b5990253fc843afb087f1361687b9e6/users/79b8cf4ccfda4e26a5c421acc6b113e8/roles/6fa4573097ea4494b215fa0be868f8cd` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:48.999454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7346b4b-3a61-4060-9916-c20cafe9771d None admin] RBAC: Authorizing `identity:create_grant(project_id=5b5990253fc843afb087f1361687b9e6, user_id=79b8cf4ccfda4e26a5c421acc6b113e8, role_id=6fa4573097ea4494b215fa0be868f8cd)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:49.000869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7346b4b-3a61-4060-9916-c20cafe9771d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:49.051901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 561/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:24:48 2022] PUT /identity/v3/projects/5b5990253fc843afb087f1361687b9e6/users/79b8cf4ccfda4e26a5c421acc6b113e8/roles/6fa4573097ea4494b215fa0be868f8cd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:24:51.235478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee8014-dab9-4ea1-93be-ebf506c46a28 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:51.236043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee8014-dab9-4ea1-93be-ebf506c46a28 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:51.236043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee8014-dab9-4ea1-93be-ebf506c46a28 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:51.237397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 563/1124] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:51.243141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee66ae-dc7c-451c-b7f4-21bea37850b8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:51.243579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee66ae-dc7c-451c-b7f4-21bea37850b8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:51.243857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee66ae-dc7c-451c-b7f4-21bea37850b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:51.260841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b7ee66ae-dc7c-451c-b7f4-21bea37850b8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:51.262019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b7ee66ae-dc7c-451c-b7f4-21bea37850b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:51.279080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:51.327066 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 562/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:51.350249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee8014-dab9-4ea1-93be-ebf506c46a28 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:51.374929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:51.451395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee8014-dab9-4ea1-93be-ebf506c46a28 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:51.484450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc3b7-ddad-4078-bdd3-cc29930752df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:51.485286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc3b7-ddad-4078-bdd3-cc29930752df None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:51.485567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc3b7-ddad-4078-bdd3-cc29930752df None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:51.485838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bc3b7-ddad-4078-bdd3-cc29930752df None admin] PATH_INFO: `/v3/roles/6fa4573097ea4494b215fa0be868f8cd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:51.487331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc3b7-ddad-4078-bdd3-cc29930752df None admin] RBAC: Authorizing `identity:get_role(role_id=6fa4573097ea4494b215fa0be868f8cd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:51.488700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bc3b7-ddad-4078-bdd3-cc29930752df None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:51.490085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 564/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:51 2022] GET /identity/v3/roles/6fa4573097ea4494b215fa0be868f8cd => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:51.496423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee66ae-dc7c-451c-b7f4-21bea37850b8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:51.593024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee66ae-dc7c-451c-b7f4-21bea37850b8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:51.626326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ef71d-9df1-4dba-86ea-56ff52dc701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:51.627182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ef71d-9df1-4dba-86ea-56ff52dc701d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:51.627459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ef71d-9df1-4dba-86ea-56ff52dc701d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:51.627730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ef71d-9df1-4dba-86ea-56ff52dc701d None admin] PATH_INFO: `/v3/users/79b8cf4ccfda4e26a5c421acc6b113e8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:51.628882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ef71d-9df1-4dba-86ea-56ff52dc701d None admin] RBAC: Authorizing `identity:get_user(user_id=79b8cf4ccfda4e26a5c421acc6b113e8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:51.630314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ef71d-9df1-4dba-86ea-56ff52dc701d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:51.631904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 563/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:24:51 2022] GET /identity/v3/users/79b8cf4ccfda4e26a5c421acc6b113e8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:51.637918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc3b7-ddad-4078-bdd3-cc29930752df None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:51.726161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:51.736266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bc3b7-ddad-4078-bdd3-cc29930752df None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:51.769691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61e91-4756-4049-b28b-62a67e131b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:51.770357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61e91-4756-4049-b28b-62a67e131b14 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:51.770637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61e91-4756-4049-b28b-62a67e131b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:51.770911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61e91-4756-4049-b28b-62a67e131b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:51.838099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61e91-4756-4049-b28b-62a67e131b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:51.839531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61e91-4756-4049-b28b-62a67e131b14 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:51.923961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:51.934278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 565/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:24:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:24:51.940090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ef71d-9df1-4dba-86ea-56ff52dc701d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:51.964372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:52.037036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ef71d-9df1-4dba-86ea-56ff52dc701d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:52.071217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa68760-39e6-4845-8d89-017ed29c4e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:52.072061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa68760-39e6-4845-8d89-017ed29c4e52 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:52.072337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa68760-39e6-4845-8d89-017ed29c4e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:52.072603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa68760-39e6-4845-8d89-017ed29c4e52 None admin] PATH_INFO: `/v3/projects/5b5990253fc843afb087f1361687b9e6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:52.073755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa68760-39e6-4845-8d89-017ed29c4e52 None admin] RBAC: Authorizing `identity:get_project(project_id=5b5990253fc843afb087f1361687b9e6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:52.075193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa68760-39e6-4845-8d89-017ed29c4e52 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:52.076855 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 564/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:24:51 2022] GET /identity/v3/projects/5b5990253fc843afb087f1361687b9e6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:52.082897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61e91-4756-4049-b28b-62a67e131b14 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:52.178909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61e91-4756-4049-b28b-62a67e131b14 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:52.212304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b280-3900-4e2b-b61d-ebc6ada9e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:52.212932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b280-3900-4e2b-b61d-ebc6ada9e68e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:52.213207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b280-3900-4e2b-b61d-ebc6ada9e68e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:52.213474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b280-3900-4e2b-b61d-ebc6ada9e68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:52.214317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b280-3900-4e2b-b61d-ebc6ada9e68e None admin] RBAC: Adding query filter params (role.id=6fa4573097ea4494b215fa0be868f8cd, scope.project.id=5b5990253fc843afb087f1361687b9e6, user.id=79b8cf4ccfda4e26a5c421acc6b113e8) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:24:52.214621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b280-3900-4e2b-b61d-ebc6ada9e68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:52.216030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b280-3900-4e2b-b61d-ebc6ada9e68e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:52.221727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 566/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:24:52 2022] GET /identity/v3/role_assignments?user.id=79b8cf4ccfda4e26a5c421acc6b113e8&scope.project.id=5b5990253fc843afb087f1361687b9e6&role.id=6fa4573097ea4494b215fa0be868f8cd => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:54.419900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5e9b-6eb9-4713-8b63-bc63868afcf0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:54.420429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5e9b-6eb9-4713-8b63-bc63868afcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:54.420429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5e9b-6eb9-4713-8b63-bc63868afcf0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:54.421792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 565/1131] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:54.426899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f84d-b571-4d88-b0e3-85521e7dfe3e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:54.427325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f84d-b571-4d88-b0e3-85521e7dfe3e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:54.427432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f84d-b571-4d88-b0e3-85521e7dfe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:54.443942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c748f84d-b571-4d88-b0e3-85521e7dfe3e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:54.445092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c748f84d-b571-4d88-b0e3-85521e7dfe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:54.492558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:54.510475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 567/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:54.533922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5e9b-6eb9-4713-8b63-bc63868afcf0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:54.623661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:54.634620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5e9b-6eb9-4713-8b63-bc63868afcf0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:54.668770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0e49e-2e9c-4f27-afb7-e98be9f9a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:54.669534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0e49e-2e9c-4f27-afb7-e98be9f9a541 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:54.669813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0e49e-2e9c-4f27-afb7-e98be9f9a541 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:54.670166 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0e49e-2e9c-4f27-afb7-e98be9f9a541 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:54.671285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0e49e-2e9c-4f27-afb7-e98be9f9a541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:54.672705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0e49e-2e9c-4f27-afb7-e98be9f9a541 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:54.674307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 566/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:24:54.680222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748f84d-b571-4d88-b0e3-85521e7dfe3e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:54.776352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748f84d-b571-4d88-b0e3-85521e7dfe3e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:54.809075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3981cb-57e1-4106-98db-52791d2433e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:54.809710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3981cb-57e1-4106-98db-52791d2433e3 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:54.809991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3981cb-57e1-4106-98db-52791d2433e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:54.810296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3981cb-57e1-4106-98db-52791d2433e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:54.810978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3981cb-57e1-4106-98db-52791d2433e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:54.812499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3981cb-57e1-4106-98db-52791d2433e3 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:54.895865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 568/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:24:54 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:24:57.114889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7cdee-fea0-43d7-8d86-b49a7b656002 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:57.115394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7cdee-fea0-43d7-8d86-b49a7b656002 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:57.115503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7cdee-fea0-43d7-8d86-b49a7b656002 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:57.116784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 567/1135] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:57.122451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedd123-0a11-4636-80ee-e28fe8fe2a55 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:57.122854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedd123-0a11-4636-80ee-e28fe8fe2a55 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:57.123002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dedd123-0a11-4636-80ee-e28fe8fe2a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:57.139951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0dedd123-0a11-4636-80ee-e28fe8fe2a55 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:57.141102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0dedd123-0a11-4636-80ee-e28fe8fe2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:57.168579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:57.205970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 569/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:57.230443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7cdee-fea0-43d7-8d86-b49a7b656002 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:57.329736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7cdee-fea0-43d7-8d86-b49a7b656002 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:57.362591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350c274-a98b-4701-8dfa-82c3274f7061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:57.363356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c274-a98b-4701-8dfa-82c3274f7061 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:57.363635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c274-a98b-4701-8dfa-82c3274f7061 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:57.363907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c274-a98b-4701-8dfa-82c3274f7061 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:57.365042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350c274-a98b-4701-8dfa-82c3274f7061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:57.366493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350c274-a98b-4701-8dfa-82c3274f7061 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:57.368164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 568/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:24:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:24:57.373683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedd123-0a11-4636-80ee-e28fe8fe2a55 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:57.469921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dedd123-0a11-4636-80ee-e28fe8fe2a55 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:24:57.503061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ee255-09dc-49ae-96e7-870435560a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:24:57.503712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ee255-09dc-49ae-96e7-870435560a66 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:57.503992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ee255-09dc-49ae-96e7-870435560a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:57.504263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ee255-09dc-49ae-96e7-870435560a66 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:57.504966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ee255-09dc-49ae-96e7-870435560a66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:24:57.506436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ee255-09dc-49ae-96e7-870435560a66 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:24:57.594716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 570/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:24:57 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:24:59.802655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40d632-b20f-4e49-8127-6840b5c3fbb8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:59.803193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40d632-b20f-4e49-8127-6840b5c3fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:59.803193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40d632-b20f-4e49-8127-6840b5c3fbb8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:59.804643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 569/1139] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:24:59.810524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e982a-b064-4d53-9449-b90dc82534f9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:24:59.810905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e982a-b064-4d53-9449-b90dc82534f9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:24:59.811076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e982a-b064-4d53-9449-b90dc82534f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:24:59.827968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d61e982a-b064-4d53-9449-b90dc82534f9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:24:59.829136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d61e982a-b064-4d53-9449-b90dc82534f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:24:59.845106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:24:59.893851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 571/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:24:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:24:59.917321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40d632-b20f-4e49-8127-6840b5c3fbb8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:24:59.944425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:00.018600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40d632-b20f-4e49-8127-6840b5c3fbb8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:00.052972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9a0e5-c01e-4ec3-97e3-08cf83bd1d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:00.053686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9a0e5-c01e-4ec3-97e3-08cf83bd1d47 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:00.053966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9a0e5-c01e-4ec3-97e3-08cf83bd1d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:00.054276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9a0e5-c01e-4ec3-97e3-08cf83bd1d47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:00.064652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9a0e5-c01e-4ec3-97e3-08cf83bd1d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f1f9a0e5-c01e-4ec3-97e3-08cf83bd1d47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:25:00.072917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:25:00.074077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:25:00.075323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 570/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:25:00.079996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e982a-b064-4d53-9449-b90dc82534f9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:00.175740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e982a-b064-4d53-9449-b90dc82534f9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:00.208009 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:00.208652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:00.208930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:00.209203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:00.209942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:00.210276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:00.212214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:00.219984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 572/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:00.225599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9a0e5-c01e-4ec3-97e3-08cf83bd1d47 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:00.308370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:00.322992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9a0e5-c01e-4ec3-97e3-08cf83bd1d47 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:00.355342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758e2e7-a28b-43e5-b3cd-a64bde3c893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:00.356185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758e2e7-a28b-43e5-b3cd-a64bde3c893b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:00.356458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758e2e7-a28b-43e5-b3cd-a64bde3c893b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:00.356722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758e2e7-a28b-43e5-b3cd-a64bde3c893b None admin] PATH_INFO: `/v3/users/50a2c9bf3e244502a96a82288e30f23e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:00.369457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758e2e7-a28b-43e5-b3cd-a64bde3c893b None admin] RBAC: Authorizing `identity:get_user(user_id=50a2c9bf3e244502a96a82288e30f23e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:00.370890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758e2e7-a28b-43e5-b3cd-a64bde3c893b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:00.372489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 571/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:25:00 2022] GET /identity/v3/users/50a2c9bf3e244502a96a82288e30f23e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:00.377979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:00.393865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:00.475115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9992b-04c9-4bc9-a58d-5a939a8e15ad None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:00.506544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67a9b-83ac-425d-b55f-ba62bb5ab32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:00.507161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67a9b-83ac-425d-b55f-ba62bb5ab32f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:00.507436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67a9b-83ac-425d-b55f-ba62bb5ab32f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:00.508232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd67a9b-83ac-425d-b55f-ba62bb5ab32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:00.571950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd67a9b-83ac-425d-b55f-ba62bb5ab32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:00.573307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd67a9b-83ac-425d-b55f-ba62bb5ab32f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:00.587336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:00.667966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 573/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:25:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:25:00.673722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758e2e7-a28b-43e5-b3cd-a64bde3c893b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:00.769607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758e2e7-a28b-43e5-b3cd-a64bde3c893b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:00.801350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f88a2-73b3-48dc-96fc-956ebd80a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:00.802210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f88a2-73b3-48dc-96fc-956ebd80a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:00.802485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f88a2-73b3-48dc-96fc-956ebd80a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:00.802754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f88a2-73b3-48dc-96fc-956ebd80a4b0 None admin] PATH_INFO: `/v3/projects/7a50b4cdba9e474988b8bfc2095a4245` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:00.803944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f88a2-73b3-48dc-96fc-956ebd80a4b0 None admin] RBAC: Authorizing `identity:get_project(project_id=7a50b4cdba9e474988b8bfc2095a4245)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:00.805898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f88a2-73b3-48dc-96fc-956ebd80a4b0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:00.807558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 572/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:25:00 2022] GET /identity/v3/projects/7a50b4cdba9e474988b8bfc2095a4245 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:00.813388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67a9b-83ac-425d-b55f-ba62bb5ab32f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:00.911313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd67a9b-83ac-425d-b55f-ba62bb5ab32f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:00.924911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:00.945044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00fcc8b-0975-47d7-9c40-9bca7a8fc796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:00.946720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fcc8b-0975-47d7-9c40-9bca7a8fc796 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:00.947008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fcc8b-0975-47d7-9c40-9bca7a8fc796 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:00.947286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fcc8b-0975-47d7-9c40-9bca7a8fc796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:00.948108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fcc8b-0975-47d7-9c40-9bca7a8fc796 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=7a50b4cdba9e474988b8bfc2095a4245, user.id=50a2c9bf3e244502a96a82288e30f23e) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:00.948418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fcc8b-0975-47d7-9c40-9bca7a8fc796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:00.949852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00fcc8b-0975-47d7-9c40-9bca7a8fc796 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:00.955213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 574/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:25:00 2022] GET /identity/v3/role_assignments?user.id=50a2c9bf3e244502a96a82288e30f23e&scope.project.id=7a50b4cdba9e474988b8bfc2095a4245&role.id=fe643140d2134736a54afd972d47d43f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:03.153755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98205-12b0-4d92-b961-444566019bac None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:03.154331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98205-12b0-4d92-b961-444566019bac None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:03.154331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c98205-12b0-4d92-b961-444566019bac None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:03.155685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 573/1147] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:03.160984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2c5c-2334-4ffe-8106-b369336bdca7 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:03.161401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2c5c-2334-4ffe-8106-b369336bdca7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:03.161519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2c5c-2334-4ffe-8106-b369336bdca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:03.177870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cf1d2c5c-2334-4ffe-8106-b369336bdca7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:03.179065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cf1d2c5c-2334-4ffe-8106-b369336bdca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:03.244407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 575/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:25:03.267255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c98205-12b0-4d92-b961-444566019bac None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:03.281644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:03.367075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c98205-12b0-4d92-b961-444566019bac None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:03.400836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a96c6c-940f-4919-96fa-8a39ab3597d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:03.401604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a96c6c-940f-4919-96fa-8a39ab3597d9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:03.401885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a96c6c-940f-4919-96fa-8a39ab3597d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:03.402188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a96c6c-940f-4919-96fa-8a39ab3597d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:03.411866 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a96c6c-940f-4919-96fa-8a39ab3597d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-39a96c6c-940f-4919-96fa-8a39ab3597d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:25:03.424895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:25:03.426061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:25:03.427291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 574/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:25:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:25:03.432632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2c5c-2334-4ffe-8106-b369336bdca7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:03.527914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2c5c-2334-4ffe-8106-b369336bdca7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:03.536718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:03.561310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:03.561969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:03.562281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:03.562556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:03.563290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:03.563596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:03.564998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:03.573784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 576/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:25:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:03.579584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a96c6c-940f-4919-96fa-8a39ab3597d9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:03.647813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:03.676863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a96c6c-940f-4919-96fa-8a39ab3597d9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:03.709273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef9047-5c95-41d9-87ea-6019ec49fad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:03.710147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef9047-5c95-41d9-87ea-6019ec49fad5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:03.710427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef9047-5c95-41d9-87ea-6019ec49fad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:03.710700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef9047-5c95-41d9-87ea-6019ec49fad5 None admin] PATH_INFO: `/v3/users/50a2c9bf3e244502a96a82288e30f23e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:03.712359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef9047-5c95-41d9-87ea-6019ec49fad5 None admin] RBAC: Authorizing `identity:get_user(user_id=50a2c9bf3e244502a96a82288e30f23e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:03.713765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef9047-5c95-41d9-87ea-6019ec49fad5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:03.715458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 575/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:25:03 2022] GET /identity/v3/users/50a2c9bf3e244502a96a82288e30f23e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:03.721095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:03.821675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198b47e-d5de-4cda-8035-c2069b544dae None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:03.854412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68a0fe-4eb5-463c-ad29-8c4931686175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:03.855251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68a0fe-4eb5-463c-ad29-8c4931686175 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:03.855527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68a0fe-4eb5-463c-ad29-8c4931686175 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:03.855796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68a0fe-4eb5-463c-ad29-8c4931686175 None admin] PATH_INFO: `/v3/projects/7a50b4cdba9e474988b8bfc2095a4245` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:03.856954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68a0fe-4eb5-463c-ad29-8c4931686175 None admin] RBAC: Authorizing `identity:get_project(project_id=7a50b4cdba9e474988b8bfc2095a4245)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:03.858418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68a0fe-4eb5-463c-ad29-8c4931686175 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:03.860100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 577/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:25:03 2022] GET /identity/v3/projects/7a50b4cdba9e474988b8bfc2095a4245 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:03.865849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef9047-5c95-41d9-87ea-6019ec49fad5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:03.962965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef9047-5c95-41d9-87ea-6019ec49fad5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:03.995115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e16b10-3880-4392-a920-c7525c100139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:03.995978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16b10-3880-4392-a920-c7525c100139 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:03.996252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16b10-3880-4392-a920-c7525c100139 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:03.996518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e16b10-3880-4392-a920-c7525c100139 None admin] PATH_INFO: `/v3/projects/7a50b4cdba9e474988b8bfc2095a4245/users/50a2c9bf3e244502a96a82288e30f23e/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:03.998467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e16b10-3880-4392-a920-c7525c100139 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a50b4cdba9e474988b8bfc2095a4245, user_id=50a2c9bf3e244502a96a82288e30f23e, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:03.999879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e16b10-3880-4392-a920-c7525c100139 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:04.099227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:04.104556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 576/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:25:03 2022] PUT /identity/v3/projects/7a50b4cdba9e474988b8bfc2095a4245/users/50a2c9bf3e244502a96a82288e30f23e/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:25:06.281846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ed71-aaf1-48d2-872f-7d04cff34e15 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:06.282433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ed71-aaf1-48d2-872f-7d04cff34e15 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:06.282433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402ed71-aaf1-48d2-872f-7d04cff34e15 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:06.283778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 578/1154] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:06.289083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ee57-a2c9-4909-b37d-0d1378de1e34 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:06.289590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ee57-a2c9-4909-b37d-0d1378de1e34 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:06.289883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07ee57-a2c9-4909-b37d-0d1378de1e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:06.306865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9e07ee57-a2c9-4909-b37d-0d1378de1e34 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:06.308035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9e07ee57-a2c9-4909-b37d-0d1378de1e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:06.374303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 577/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:25:06.396886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402ed71-aaf1-48d2-872f-7d04cff34e15 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:06.437287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:06.496957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402ed71-aaf1-48d2-872f-7d04cff34e15 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:06.528972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d28c3f-0ceb-47ba-819e-546a06e89b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:06.529742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d28c3f-0ceb-47ba-819e-546a06e89b52 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:06.530040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d28c3f-0ceb-47ba-819e-546a06e89b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:06.530317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d28c3f-0ceb-47ba-819e-546a06e89b52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:06.540759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d28c3f-0ceb-47ba-819e-546a06e89b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-36d28c3f-0ceb-47ba-819e-546a06e89b52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:25:06.548368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:25:06.549483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:06.550601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:25:06.554143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 579/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:25:06.555937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ee57-a2c9-4909-b37d-0d1378de1e34 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:06.649806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07ee57-a2c9-4909-b37d-0d1378de1e34 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:06.677028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:06.683292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:06.683937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:06.684215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:06.686162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:06.686162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:06.686162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:06.686905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:06.694882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 578/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:06.700623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d28c3f-0ceb-47ba-819e-546a06e89b52 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:06.794836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:06.798562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d28c3f-0ceb-47ba-819e-546a06e89b52 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:06.831944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178e6e3-e6db-4a8f-8e65-0e8e58b95f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:06.832801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e6e3-e6db-4a8f-8e65-0e8e58b95f43 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:06.833080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e6e3-e6db-4a8f-8e65-0e8e58b95f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:06.833356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178e6e3-e6db-4a8f-8e65-0e8e58b95f43 None admin] PATH_INFO: `/v3/users/50a2c9bf3e244502a96a82288e30f23e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:06.834552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178e6e3-e6db-4a8f-8e65-0e8e58b95f43 None admin] RBAC: Authorizing `identity:get_user(user_id=50a2c9bf3e244502a96a82288e30f23e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:06.836531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178e6e3-e6db-4a8f-8e65-0e8e58b95f43 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:06.838161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 580/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:25:06 2022] GET /identity/v3/users/50a2c9bf3e244502a96a82288e30f23e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:06.843706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:06.940173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b3852-4c62-411c-833c-6aa68ff442f5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:06.972677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0382912-b9fa-4709-8b2f-80cbe5280d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:06.973310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0382912-b9fa-4709-8b2f-80cbe5280d78 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:06.973589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0382912-b9fa-4709-8b2f-80cbe5280d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:06.973852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0382912-b9fa-4709-8b2f-80cbe5280d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:07.029004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:07.037866 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0382912-b9fa-4709-8b2f-80cbe5280d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:07.039345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0382912-b9fa-4709-8b2f-80cbe5280d78 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:07.135637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 579/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:25:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 22:25:07.141456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178e6e3-e6db-4a8f-8e65-0e8e58b95f43 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:07.236586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178e6e3-e6db-4a8f-8e65-0e8e58b95f43 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:07.271306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567739cb-7eb3-41e9-b5c6-a158c6dca0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:07.272205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567739cb-7eb3-41e9-b5c6-a158c6dca0ff None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:07.272574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567739cb-7eb3-41e9-b5c6-a158c6dca0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:07.272853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567739cb-7eb3-41e9-b5c6-a158c6dca0ff None admin] PATH_INFO: `/v3/projects/7a50b4cdba9e474988b8bfc2095a4245` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:07.274432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567739cb-7eb3-41e9-b5c6-a158c6dca0ff None admin] RBAC: Authorizing `identity:get_project(project_id=7a50b4cdba9e474988b8bfc2095a4245)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:07.275790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567739cb-7eb3-41e9-b5c6-a158c6dca0ff None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:07.277502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 581/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:25:07 2022] GET /identity/v3/projects/7a50b4cdba9e474988b8bfc2095a4245 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:07.283922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0382912-b9fa-4709-8b2f-80cbe5280d78 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:07.372833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:07.381118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0382912-b9fa-4709-8b2f-80cbe5280d78 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:07.415443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342cba9-682d-4b8c-a7c9-0ee7ee43da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:07.416099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cba9-682d-4b8c-a7c9-0ee7ee43da85 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:07.416378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cba9-682d-4b8c-a7c9-0ee7ee43da85 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:07.416651 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cba9-682d-4b8c-a7c9-0ee7ee43da85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:07.417473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cba9-682d-4b8c-a7c9-0ee7ee43da85 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=7a50b4cdba9e474988b8bfc2095a4245, user.id=50a2c9bf3e244502a96a82288e30f23e) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:07.417781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cba9-682d-4b8c-a7c9-0ee7ee43da85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:07.419250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cba9-682d-4b8c-a7c9-0ee7ee43da85 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:07.424927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 580/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:25:07 2022] GET /identity/v3/role_assignments?user.id=50a2c9bf3e244502a96a82288e30f23e&scope.project.id=7a50b4cdba9e474988b8bfc2095a4245&role.id=fe643140d2134736a54afd972d47d43f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:09.667164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc94e-1c4b-4858-98aa-e06511cea394 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:09.667705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc94e-1c4b-4858-98aa-e06511cea394 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:09.667705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bc94e-1c4b-4858-98aa-e06511cea394 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:09.669060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 582/1162] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:09.674226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677e778-9918-4849-b47d-817e7c10ca0c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:09.674621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677e778-9918-4849-b47d-817e7c10ca0c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:09.674782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677e778-9918-4849-b47d-817e7c10ca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:09.691497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5677e778-9918-4849-b47d-817e7c10ca0c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:09.692947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5677e778-9918-4849-b47d-817e7c10ca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:09.758946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 581/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:25:09.780666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bc94e-1c4b-4858-98aa-e06511cea394 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:09.815024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:09.879699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1bc94e-1c4b-4858-98aa-e06511cea394 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:09.912004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420ed38-e96a-4807-aa74-38b3cc2571fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:09.912623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ed38-e96a-4807-aa74-38b3cc2571fd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:09.912898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ed38-e96a-4807-aa74-38b3cc2571fd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:09.913167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420ed38-e96a-4807-aa74-38b3cc2571fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:09.976774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420ed38-e96a-4807-aa74-38b3cc2571fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:09.978294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420ed38-e96a-4807-aa74-38b3cc2571fd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:10.009306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:10.074086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 583/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:25:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:25:10.079987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677e778-9918-4849-b47d-817e7c10ca0c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:10.161301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:10.175325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677e778-9918-4849-b47d-817e7c10ca0c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:10.208408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ed842-9914-40bb-97f4-3ef55f3379cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:10.209192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed842-9914-40bb-97f4-3ef55f3379cd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:10.209473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed842-9914-40bb-97f4-3ef55f3379cd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:10.209745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ed842-9914-40bb-97f4-3ef55f3379cd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:10.216616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ed842-9914-40bb-97f4-3ef55f3379cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:10.218095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ed842-9914-40bb-97f4-3ef55f3379cd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-fa9ed842-9914-40bb-97f4-3ef55f3379cd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:25:10.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:25:10.233951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:25:10.235216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 582/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:25:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:25:10.239591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420ed38-e96a-4807-aa74-38b3cc2571fd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:10.335842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420ed38-e96a-4807-aa74-38b3cc2571fd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:10.369618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf2bbd-7035-4fc7-a294-df01252c2840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:10.370287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2bbd-7035-4fc7-a294-df01252c2840 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:10.370568 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2bbd-7035-4fc7-a294-df01252c2840 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:10.370842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2bbd-7035-4fc7-a294-df01252c2840 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:10.371550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf2bbd-7035-4fc7-a294-df01252c2840 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:10.371854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf2bbd-7035-4fc7-a294-df01252c2840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:10.373210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf2bbd-7035-4fc7-a294-df01252c2840 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:10.374619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:10.380646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 584/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Wed May 18 22:25:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:12.572270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5fd2-06a8-4cd4-923f-f24490a8fd51 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:12.572804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5fd2-06a8-4cd4-923f-f24490a8fd51 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:12.572804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a5fd2-06a8-4cd4-923f-f24490a8fd51 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:12.574207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 583/1167] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:12.579358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7259-ef3f-4c45-853f-49e1dbf0fabe None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:12.579794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7259-ef3f-4c45-853f-49e1dbf0fabe None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:12.579890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f7259-ef3f-4c45-853f-49e1dbf0fabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:12.596169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-558f7259-ef3f-4c45-853f-49e1dbf0fabe None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:12.597320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-558f7259-ef3f-4c45-853f-49e1dbf0fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:12.663641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 585/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:25:12.687102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a5fd2-06a8-4cd4-923f-f24490a8fd51 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:12.785039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a5fd2-06a8-4cd4-923f-f24490a8fd51 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:12.817387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa97c6-7b00-4c3d-aca3-6c422e39fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:12.818049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa97c6-7b00-4c3d-aca3-6c422e39fe80 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:12.818329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa97c6-7b00-4c3d-aca3-6c422e39fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:12.818595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa97c6-7b00-4c3d-aca3-6c422e39fe80 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:12.819315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa97c6-7b00-4c3d-aca3-6c422e39fe80 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:12.821268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa97c6-7b00-4c3d-aca3-6c422e39fe80 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:12.881332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 584/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Wed May 18 22:25:12 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:25:15.094100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567be5b5-1bca-4f9a-9254-3d3ad7ee1f9e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:15.094585 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567be5b5-1bca-4f9a-9254-3d3ad7ee1f9e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:15.094681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567be5b5-1bca-4f9a-9254-3d3ad7ee1f9e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:15.095995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 586/1170] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:15.101117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075b7ac-4428-4b0a-9bce-c8f660b28e6a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:15.101997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075b7ac-4428-4b0a-9bce-c8f660b28e6a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:15.101997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075b7ac-4428-4b0a-9bce-c8f660b28e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:15.113028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:15.119006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b075b7ac-4428-4b0a-9bce-c8f660b28e6a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:15.120175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b075b7ac-4428-4b0a-9bce-c8f660b28e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:15.185422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 585/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:25:15.209189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567be5b5-1bca-4f9a-9254-3d3ad7ee1f9e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:15.306573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567be5b5-1bca-4f9a-9254-3d3ad7ee1f9e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:15.332239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:15.339722 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca2b17-9eda-4304-8105-890f218be02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:15.340716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca2b17-9eda-4304-8105-890f218be02e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:15.340993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca2b17-9eda-4304-8105-890f218be02e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:15.341262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca2b17-9eda-4304-8105-890f218be02e None admin] PATH_INFO: `/v3/domains/71dd3fdeb8f8400aa22d7e8dbd967f04` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:15.352063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca2b17-9eda-4304-8105-890f218be02e None admin] RBAC: Authorizing `identity:get_domain(domain_id=71dd3fdeb8f8400aa22d7e8dbd967f04)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:15.353510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca2b17-9eda-4304-8105-890f218be02e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:15.355148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 587/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Wed May 18 22:25:15 2022] GET /identity/v3/domains/71dd3fdeb8f8400aa22d7e8dbd967f04 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:15.360880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075b7ac-4428-4b0a-9bce-c8f660b28e6a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:15.456613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075b7ac-4428-4b0a-9bce-c8f660b28e6a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:15.489659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1485c87-61bd-4bdd-93df-55c30237f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:15.490324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485c87-61bd-4bdd-93df-55c30237f68b None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:15.490606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485c87-61bd-4bdd-93df-55c30237f68b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:15.490873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485c87-61bd-4bdd-93df-55c30237f68b None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:15.491578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1485c87-61bd-4bdd-93df-55c30237f68b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:15.493593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1485c87-61bd-4bdd-93df-55c30237f68b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:15.497511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:15.567034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 586/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:25:15 2022] POST /identity/v3/projects => generated 361 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:25:17.774565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089b08-d9a1-4bc6-886c-c71fcc78963c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:17.775132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089b08-d9a1-4bc6-886c-c71fcc78963c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:17.775132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089b08-d9a1-4bc6-886c-c71fcc78963c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:17.776452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 588/1174] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:17.781550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339cfe-398f-445c-a6ef-5202df70ff40 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:17.781958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339cfe-398f-445c-a6ef-5202df70ff40 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:17.782110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14339cfe-398f-445c-a6ef-5202df70ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:17.798946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-14339cfe-398f-445c-a6ef-5202df70ff40 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:17.800103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-14339cfe-398f-445c-a6ef-5202df70ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:17.863715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 587/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:25:17.888662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d089b08-d9a1-4bc6-886c-c71fcc78963c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:17.987941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d089b08-d9a1-4bc6-886c-c71fcc78963c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:18.020105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b339839-18b1-43f4-97f6-2a41b048fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:18.020944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339839-18b1-43f4-97f6-2a41b048fb13 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:18.021217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339839-18b1-43f4-97f6-2a41b048fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:18.021496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b339839-18b1-43f4-97f6-2a41b048fb13 None admin] PATH_INFO: `/v3/domains/71dd3fdeb8f8400aa22d7e8dbd967f04` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:18.022773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b339839-18b1-43f4-97f6-2a41b048fb13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=71dd3fdeb8f8400aa22d7e8dbd967f04)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:18.024775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b339839-18b1-43f4-97f6-2a41b048fb13 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:18.026336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 589/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Wed May 18 22:25:17 2022] GET /identity/v3/domains/71dd3fdeb8f8400aa22d7e8dbd967f04 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:18.032178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339cfe-398f-445c-a6ef-5202df70ff40 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:18.131430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14339cfe-398f-445c-a6ef-5202df70ff40 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:18.147733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:18.164734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179ae8-f930-44ea-aa89-237b232456de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:18.165822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179ae8-f930-44ea-aa89-237b232456de None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:18.166134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179ae8-f930-44ea-aa89-237b232456de None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:18.166410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179ae8-f930-44ea-aa89-237b232456de None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:18.167107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179ae8-f930-44ea-aa89-237b232456de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:18.174667 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179ae8-f930-44ea-aa89-237b232456de None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:18.239743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 588/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:25:18 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:25:20.477854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74f6f-e734-4512-ab04-b7ad5b339c5c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:20.478420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74f6f-e734-4512-ab04-b7ad5b339c5c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:20.478420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e74f6f-e734-4512-ab04-b7ad5b339c5c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:20.479792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 590/1178] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:20.484955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d9f7-476b-40b4-b642-d3e44a2a5b05 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:20.485382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d9f7-476b-40b4-b642-d3e44a2a5b05 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:20.485511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72d9f7-476b-40b4-b642-d3e44a2a5b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:20.502733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bc72d9f7-476b-40b4-b642-d3e44a2a5b05 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:20.503912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc72d9f7-476b-40b4-b642-d3e44a2a5b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:20.568903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 589/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:25:20.592671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e74f6f-e734-4512-ab04-b7ad5b339c5c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:20.647981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:20.690891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e74f6f-e734-4512-ab04-b7ad5b339c5c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:20.722887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc259de-7a46-46e4-81ff-345a58c98f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:20.723649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc259de-7a46-46e4-81ff-345a58c98f5a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:20.723923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc259de-7a46-46e4-81ff-345a58c98f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:20.724190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc259de-7a46-46e4-81ff-345a58c98f5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:20.734434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc259de-7a46-46e4-81ff-345a58c98f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-1dc259de-7a46-46e4-81ff-345a58c98f5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:25:20.742689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:25:20.744299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:25:20.745896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 591/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:25:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:25:20.749698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d9f7-476b-40b4-b642-d3e44a2a5b05 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:20.843785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72d9f7-476b-40b4-b642-d3e44a2a5b05 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:20.846029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:20.877338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:20.877981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:20.878287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:20.878557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:20.879345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:20.879649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:20.880996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:20.889906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 590/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:25:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:20.895484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc259de-7a46-46e4-81ff-345a58c98f5a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:20.991582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc259de-7a46-46e4-81ff-345a58c98f5a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:21.008198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:21.025852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1df344-c6df-4d92-86a4-5b3f0cc6330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:21.026750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1df344-c6df-4d92-86a4-5b3f0cc6330e None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:21.027027 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1df344-c6df-4d92-86a4-5b3f0cc6330e None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:21.027299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1df344-c6df-4d92-86a4-5b3f0cc6330e None admin] PATH_INFO: `/v3/users/499c401933834f3db40503c6d11c8d40` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:21.041160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1df344-c6df-4d92-86a4-5b3f0cc6330e None admin] RBAC: Authorizing `identity:get_user(user_id=499c401933834f3db40503c6d11c8d40)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:21.042654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1df344-c6df-4d92-86a4-5b3f0cc6330e None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:21.044353 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 592/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:25:20 2022] GET /identity/v3/users/499c401933834f3db40503c6d11c8d40 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:21.050108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:21.146737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e39922-30e2-42db-8587-8cd7bc5ab0af None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:21.223680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d82a59-6138-41ef-a1ac-cf1881560e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:21.224305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d82a59-6138-41ef-a1ac-cf1881560e40 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:21.224586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d82a59-6138-41ef-a1ac-cf1881560e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:21.224855 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d82a59-6138-41ef-a1ac-cf1881560e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:21.256809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:21.289643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d82a59-6138-41ef-a1ac-cf1881560e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:21.291165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d82a59-6138-41ef-a1ac-cf1881560e40 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:21.385194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 591/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:25:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:25:21.391177 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1df344-c6df-4d92-86a4-5b3f0cc6330e None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:21.489603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1df344-c6df-4d92-86a4-5b3f0cc6330e None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:21.522795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38a26a-f4fd-4876-aa98-48058cd7bf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:21.523613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38a26a-f4fd-4876-aa98-48058cd7bf7c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:21.523894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38a26a-f4fd-4876-aa98-48058cd7bf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:21.524166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38a26a-f4fd-4876-aa98-48058cd7bf7c None admin] PATH_INFO: `/v3/projects/2810ef7188f8432c904648c2e971bdad` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:21.525331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38a26a-f4fd-4876-aa98-48058cd7bf7c None admin] RBAC: Authorizing `identity:get_project(project_id=2810ef7188f8432c904648c2e971bdad)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:21.526795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38a26a-f4fd-4876-aa98-48058cd7bf7c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:21.528465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 593/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:25:21 2022] GET /identity/v3/projects/2810ef7188f8432c904648c2e971bdad => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:21.534553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d82a59-6138-41ef-a1ac-cf1881560e40 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:21.598700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:21.632455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d82a59-6138-41ef-a1ac-cf1881560e40 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:21.666120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f0988-46fa-4541-b64b-3295e2ff0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:21.666757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f0988-46fa-4541-b64b-3295e2ff0388 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:21.667038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f0988-46fa-4541-b64b-3295e2ff0388 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:21.667315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f0988-46fa-4541-b64b-3295e2ff0388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:21.668133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f0988-46fa-4541-b64b-3295e2ff0388 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=2810ef7188f8432c904648c2e971bdad, user.id=499c401933834f3db40503c6d11c8d40) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:21.668440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f0988-46fa-4541-b64b-3295e2ff0388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:21.669889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f0988-46fa-4541-b64b-3295e2ff0388 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:21.675233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 592/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:25:21 2022] GET /identity/v3/role_assignments?user.id=499c401933834f3db40503c6d11c8d40&scope.project.id=2810ef7188f8432c904648c2e971bdad&role.id=fe643140d2134736a54afd972d47d43f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:23.866666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6324b-9656-4956-99be-61c9d2351e40 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:23.867419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6324b-9656-4956-99be-61c9d2351e40 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:23.867419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6324b-9656-4956-99be-61c9d2351e40 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:23.868707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 594/1186] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:23.874149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bbb8-5f9f-45d8-9606-f8771e5e48de None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:23.874557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bbb8-5f9f-45d8-9606-f8771e5e48de None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:23.874695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bbb8-5f9f-45d8-9606-f8771e5e48de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:23.891555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b2b4bbb8-5f9f-45d8-9606-f8771e5e48de None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:23.892722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b2b4bbb8-5f9f-45d8-9606-f8771e5e48de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:23.956486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 593/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:25:23.978526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6324b-9656-4956-99be-61c9d2351e40 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:24.022579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:24.078698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6324b-9656-4956-99be-61c9d2351e40 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:24.110837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897c58-c837-43bf-ac3d-4e14102452cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:24.111609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897c58-c837-43bf-ac3d-4e14102452cc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:24.111883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897c58-c837-43bf-ac3d-4e14102452cc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:24.112150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9897c58-c837-43bf-ac3d-4e14102452cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:24.122560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9897c58-c837-43bf-ac3d-4e14102452cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e9897c58-c837-43bf-ac3d-4e14102452cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:25:24.129994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:25:24.131146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:25:24.132216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 595/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:25:24.137306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4bbb8-5f9f-45d8-9606-f8771e5e48de None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:24.194874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:24.235078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4bbb8-5f9f-45d8-9606-f8771e5e48de None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:24.267623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:24.268269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:24.268549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:24.268824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:24.269556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:24.269862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:24.271246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:24.279897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 594/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:25:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:24.285579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897c58-c837-43bf-ac3d-4e14102452cc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:24.382139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9897c58-c837-43bf-ac3d-4e14102452cc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:24.383766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:24.414963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36905-21bf-4de5-8c30-726b1923e8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:24.415806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36905-21bf-4de5-8c30-726b1923e8ac None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:24.416082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36905-21bf-4de5-8c30-726b1923e8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:24.416351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac36905-21bf-4de5-8c30-726b1923e8ac None admin] PATH_INFO: `/v3/users/499c401933834f3db40503c6d11c8d40` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:24.417503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36905-21bf-4de5-8c30-726b1923e8ac None admin] RBAC: Authorizing `identity:get_user(user_id=499c401933834f3db40503c6d11c8d40)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:24.418939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac36905-21bf-4de5-8c30-726b1923e8ac None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:24.420530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 596/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:25:24 2022] GET /identity/v3/users/499c401933834f3db40503c6d11c8d40 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:24.426133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:24.524332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa775ea-e170-49ff-a3b8-6e5d877546b3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:24.545770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:24.557236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf7c4c-c902-4ebf-96e0-878c8b80e9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:24.559142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7c4c-c902-4ebf-96e0-878c8b80e9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:24.559142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7c4c-c902-4ebf-96e0-878c8b80e9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:24.559142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7c4c-c902-4ebf-96e0-878c8b80e9b8 None admin] PATH_INFO: `/v3/projects/2810ef7188f8432c904648c2e971bdad` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:24.559886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf7c4c-c902-4ebf-96e0-878c8b80e9b8 None admin] RBAC: Authorizing `identity:get_project(project_id=2810ef7188f8432c904648c2e971bdad)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:24.561300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf7c4c-c902-4ebf-96e0-878c8b80e9b8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:24.563016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 595/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:25:24 2022] GET /identity/v3/projects/2810ef7188f8432c904648c2e971bdad => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:24.569013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36905-21bf-4de5-8c30-726b1923e8ac None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:24.666303 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac36905-21bf-4de5-8c30-726b1923e8ac None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:24.699615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11620443-3649-43c7-b10d-fc5e76bc5d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:24.700479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620443-3649-43c7-b10d-fc5e76bc5d81 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:24.700758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620443-3649-43c7-b10d-fc5e76bc5d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:24.701032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11620443-3649-43c7-b10d-fc5e76bc5d81 None admin] PATH_INFO: `/v3/projects/2810ef7188f8432c904648c2e971bdad/users/499c401933834f3db40503c6d11c8d40/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:24.702985 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11620443-3649-43c7-b10d-fc5e76bc5d81 None admin] RBAC: Authorizing `identity:create_grant(project_id=2810ef7188f8432c904648c2e971bdad, user_id=499c401933834f3db40503c6d11c8d40, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:24.704403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11620443-3649-43c7-b10d-fc5e76bc5d81 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:24.765767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 597/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:25:24 2022] PUT /identity/v3/projects/2810ef7188f8432c904648c2e971bdad/users/499c401933834f3db40503c6d11c8d40/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:25:26.941528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a881-5938-4211-8319-8bc2878461a3 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:26.942336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a881-5938-4211-8319-8bc2878461a3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:26.942336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60a881-5938-4211-8319-8bc2878461a3 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:26.943720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 596/1193] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:25:26.949366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c477-2ab8-4fbc-aa5b-9eba1196f1f0 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:26.949813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c477-2ab8-4fbc-aa5b-9eba1196f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:26.949915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7c477-2ab8-4fbc-aa5b-9eba1196f1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:26.966969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7cd7c477-2ab8-4fbc-aa5b-9eba1196f1f0 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:25:26.968133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7cd7c477-2ab8-4fbc-aa5b-9eba1196f1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:25:26.990529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:27.032364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 598/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:25:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:25:27.056733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a881-5938-4211-8319-8bc2878461a3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:27.157391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60a881-5938-4211-8319-8bc2878461a3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:27.190070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d433efb-7b0b-4b96-aa1e-43c4a3931916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:27.190847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433efb-7b0b-4b96-aa1e-43c4a3931916 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:27.191126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433efb-7b0b-4b96-aa1e-43c4a3931916 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:27.191394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d433efb-7b0b-4b96-aa1e-43c4a3931916 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:27.202496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d433efb-7b0b-4b96-aa1e-43c4a3931916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8d433efb-7b0b-4b96-aa1e-43c4a3931916 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:25:27.209994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:25:27.211804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:25:27.212867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 597/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:25:27.217668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c477-2ab8-4fbc-aa5b-9eba1196f1f0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:27.313303 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7c477-2ab8-4fbc-aa5b-9eba1196f1f0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:27.345789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:27.346460 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:27.346738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:27.347008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:27.347735 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:27.348033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:27.349380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:27.357631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 599/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:27.363402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d433efb-7b0b-4b96-aa1e-43c4a3931916 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:27.411609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:27.461548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d433efb-7b0b-4b96-aa1e-43c4a3931916 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:27.494674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6fa8-fd84-47e0-b8dc-32ff13069129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:27.495522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6fa8-fd84-47e0-b8dc-32ff13069129 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:27.495796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6fa8-fd84-47e0-b8dc-32ff13069129 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:27.496064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6fa8-fd84-47e0-b8dc-32ff13069129 None admin] PATH_INFO: `/v3/users/499c401933834f3db40503c6d11c8d40` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:27.497221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee6fa8-fd84-47e0-b8dc-32ff13069129 None admin] RBAC: Authorizing `identity:get_user(user_id=499c401933834f3db40503c6d11c8d40)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:27.498673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee6fa8-fd84-47e0-b8dc-32ff13069129 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:27.500264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 598/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Wed May 18 22:25:27 2022] GET /identity/v3/users/499c401933834f3db40503c6d11c8d40 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:27.505807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:27.529831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:27.603733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4113da3-58a9-446d-9696-53dfd1c279ab None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:27.636429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636867c-c50b-4edd-b02e-6e51c350abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:27.637053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636867c-c50b-4edd-b02e-6e51c350abaf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:27.637327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636867c-c50b-4edd-b02e-6e51c350abaf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:27.637597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636867c-c50b-4edd-b02e-6e51c350abaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:27.702485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636867c-c50b-4edd-b02e-6e51c350abaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:27.703916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636867c-c50b-4edd-b02e-6e51c350abaf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:27.736714 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:27.800296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 600/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:25:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:25:27.806716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6fa8-fd84-47e0-b8dc-32ff13069129 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:27.901914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6fa8-fd84-47e0-b8dc-32ff13069129 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:27.918208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:27.934956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e574ce-acb4-47b6-b462-3d1c90c2fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:27.935792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e574ce-acb4-47b6-b462-3d1c90c2fe9e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:27.936068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e574ce-acb4-47b6-b462-3d1c90c2fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:27.936336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e574ce-acb4-47b6-b462-3d1c90c2fe9e None admin] PATH_INFO: `/v3/projects/2810ef7188f8432c904648c2e971bdad` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:27.937481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e574ce-acb4-47b6-b462-3d1c90c2fe9e None admin] RBAC: Authorizing `identity:get_project(project_id=2810ef7188f8432c904648c2e971bdad)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:27.938908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e574ce-acb4-47b6-b462-3d1c90c2fe9e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:27.940558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 599/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Wed May 18 22:25:27 2022] GET /identity/v3/projects/2810ef7188f8432c904648c2e971bdad => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:27.947794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636867c-c50b-4edd-b02e-6e51c350abaf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:25:28.044528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636867c-c50b-4edd-b02e-6e51c350abaf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:25:28.066873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:28.078816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcea014-4363-472d-9455-682263249b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:25:28.090151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcea014-4363-472d-9455-682263249b67 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:25:28.090151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcea014-4363-472d-9455-682263249b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:25:28.090151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcea014-4363-472d-9455-682263249b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:25:28.090151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcea014-4363-472d-9455-682263249b67 None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=2810ef7188f8432c904648c2e971bdad, user.id=499c401933834f3db40503c6d11c8d40) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:25:28.090151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcea014-4363-472d-9455-682263249b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:25:28.090151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcea014-4363-472d-9455-682263249b67 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:25:28.090637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 601/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:25:27 2022] GET /identity/v3/role_assignments?user.id=499c401933834f3db40503c6d11c8d40&scope.project.id=2810ef7188f8432c904648c2e971bdad&role.id=fe643140d2134736a54afd972d47d43f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:25:37.966105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:25:38.109119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=7 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:41.669481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeee20-2411-46c4-8efe-b884f6d8e263 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:41.670112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeee20-2411-46c4-8efe-b884f6d8e263 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:41.670112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeee20-2411-46c4-8efe-b884f6d8e263 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:41.671408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 600/1201] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:26:41.676789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c79f0-1de4-4d97-bcdb-8995ea34e0a6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:41.677212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c79f0-1de4-4d97-bcdb-8995ea34e0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:41.677345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c79f0-1de4-4d97-bcdb-8995ea34e0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:41.694868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5a2c79f0-1de4-4d97-bcdb-8995ea34e0a6 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:26:41.696033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5a2c79f0-1de4-4d97-bcdb-8995ea34e0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:26:41.761939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 602/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:26:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:26:41.786198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeee20-2411-46c4-8efe-b884f6d8e263 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:41.887175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeee20-2411-46c4-8efe-b884f6d8e263 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:41.920141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:41.920865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:41.921143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:41.921420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:41.931810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:41.933274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:41.950607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:41.951841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:41.953337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:41.953337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:41.953337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:41.953337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:41.953337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 601/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:41.957875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c79f0-1de4-4d97-bcdb-8995ea34e0a6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:42.057372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c79f0-1de4-4d97-bcdb-8995ea34e0a6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:42.087109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:42.092762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdca8b-26fd-45d0-8299-545aaf46f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:42.093413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdca8b-26fd-45d0-8299-545aaf46f248 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:42.093695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdca8b-26fd-45d0-8299-545aaf46f248 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:42.093971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdca8b-26fd-45d0-8299-545aaf46f248 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:42.094715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdca8b-26fd-45d0-8299-545aaf46f248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:42.095025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdca8b-26fd-45d0-8299-545aaf46f248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:42.096386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdca8b-26fd-45d0-8299-545aaf46f248 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:42.108066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 603/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:42.113748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:42.167667 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:42.214204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e4cc7-a113-478a-a657-7a36f2bc458d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:42.248264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55fdd6-881b-4723-93bb-d390941cf414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:42.248915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55fdd6-881b-4723-93bb-d390941cf414 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:42.249195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55fdd6-881b-4723-93bb-d390941cf414 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:42.249468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55fdd6-881b-4723-93bb-d390941cf414 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:42.250202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55fdd6-881b-4723-93bb-d390941cf414 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:42.251605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55fdd6-881b-4723-93bb-d390941cf414 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:42.330430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 602/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Wed May 18 22:26:42 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:26:44.556695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c465-5f0e-4ee1-9f9c-43d6cd414a74 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:44.557258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c465-5f0e-4ee1-9f9c-43d6cd414a74 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:44.557258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954c465-5f0e-4ee1-9f9c-43d6cd414a74 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:44.558652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 604/1206] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:26:44.563836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46bb6-770a-4721-ad14-7ca914f6ee69 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:44.564259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46bb6-770a-4721-ad14-7ca914f6ee69 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:44.564420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa46bb6-770a-4721-ad14-7ca914f6ee69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:44.581821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-caa46bb6-770a-4721-ad14-7ca914f6ee69 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:26:44.583128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-caa46bb6-770a-4721-ad14-7ca914f6ee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:26:44.649334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 603/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:26:44.672546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954c465-5f0e-4ee1-9f9c-43d6cd414a74 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:44.772263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954c465-5f0e-4ee1-9f9c-43d6cd414a74 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:44.804832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deb55b-0580-4511-af50-f2576fd60346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:44.805604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb55b-0580-4511-af50-f2576fd60346 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:44.805876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb55b-0580-4511-af50-f2576fd60346 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:44.806168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9deb55b-0580-4511-af50-f2576fd60346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:44.816574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9deb55b-0580-4511-af50-f2576fd60346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-c9deb55b-0580-4511-af50-f2576fd60346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:26:44.824753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:44.825919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:44.833286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 605/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:26:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:44.834261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa46bb6-770a-4721-ad14-7ca914f6ee69 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:44.871676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:44.928509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa46bb6-770a-4721-ad14-7ca914f6ee69 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:44.962070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:44.962722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:44.963006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:44.963280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:44.964015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:44.964316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:44.965673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:44.973287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 604/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:44.979898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deb55b-0580-4511-af50-f2576fd60346 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:45.030494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:45.080815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9deb55b-0580-4511-af50-f2576fd60346 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:45.114577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:45.115358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:45.115632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:45.115898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:45.126530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:45.127971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:45.145930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:45.147057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:45.148161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:45.148161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:45.148161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:45.148161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:45.148161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 606/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:45.153144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:45.248818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:45.251674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d561dca-a0d3-49cf-b71a-b9c71ea2074e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:45.284617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:45.285281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:45.285561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:45.285832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:45.286572 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:45.286876 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:45.288744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:45.300341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 605/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:45.306671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:45.404950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e350c3-cb1b-4011-baa8-e16850d9d935 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:45.407518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:45.450986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:45.451781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:45.452063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:45.452335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:45.459219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:45.460701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:26:45.476345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:45.480439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:45.481644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 607/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:45.483410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:45.581271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38af7bd-c700-473f-9685-916139217a2f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:45.615457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:45.616046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:45.617080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:45.617439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:45.618293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:45.618595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:45.620059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:45.637196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 606/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Wed May 18 22:26:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:26:45.642862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:45.742797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351a7f-fdf9-4c3c-bf5b-63243ac9a20a None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:45.775928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643ef4b-ec68-4dcc-94fb-7f727dede9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:45.776575 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643ef4b-ec68-4dcc-94fb-7f727dede9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:45.776839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643ef4b-ec68-4dcc-94fb-7f727dede9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:45.777109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643ef4b-ec68-4dcc-94fb-7f727dede9d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:45.808747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:45.847260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643ef4b-ec68-4dcc-94fb-7f727dede9d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:45.848721 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643ef4b-ec68-4dcc-94fb-7f727dede9d0 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:45.944939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 608/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:26:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:26:45.950790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:45.969953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:46.050476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d9d58-39d1-4a6c-a3fd-b0bfe676625a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:46.087126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:46.087941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:46.088223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:46.088596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:46.098402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:46.099810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:46.116795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:46.117769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:46.118793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:46.118793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:46.118793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:46.118793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:46.118793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 607/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:46.123517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643ef4b-ec68-4dcc-94fb-7f727dede9d0 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:46.185175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:46.224345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643ef4b-ec68-4dcc-94fb-7f727dede9d0 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:46.256182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:46.257373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:46.257657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:46.257931 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:46.258673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:46.258979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:46.260431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:46.271715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 609/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:46.278203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:46.348203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:46.377552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaffeb-d5f6-43f7-8ccb-38e2d9a13dfd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:46.412517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:46.413512 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:46.413806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:46.414113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:46.420550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:46.421968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:26:46.436252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:46.437362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:46.438346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 608/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:46.443503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:46.541577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53068e8d-ff77-400c-a3b9-4f5ae089c52d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:46.567290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:46.579631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f0dfa-1bce-4cf7-8aab-fb41d16639bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:46.580291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0dfa-1bce-4cf7-8aab-fb41d16639bc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:46.580567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0dfa-1bce-4cf7-8aab-fb41d16639bc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:46.580838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f0dfa-1bce-4cf7-8aab-fb41d16639bc None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:46.581612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f0dfa-1bce-4cf7-8aab-fb41d16639bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:46.581919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f0dfa-1bce-4cf7-8aab-fb41d16639bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:46.583374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f0dfa-1bce-4cf7-8aab-fb41d16639bc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:46.594911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 610/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:46.601114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:46.701789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7b727-e8a6-4a40-bd4b-71f1af42dfab None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:46.730570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:46.736181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a7657-3042-4653-b9bc-d6a216171ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:46.736817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a7657-3042-4653-b9bc-d6a216171ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:46.737095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a7657-3042-4653-b9bc-d6a216171ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:46.737365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a7657-3042-4653-b9bc-d6a216171ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:46.738212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a7657-3042-4653-b9bc-d6a216171ac3 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=e234faadf42946058f41bd8e7b43408a) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:46.738525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a7657-3042-4653-b9bc-d6a216171ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:46.739942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a7657-3042-4653-b9bc-d6a216171ac3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:46.745543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 609/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:26:46 2022] GET /identity/v3/role_assignments?user.id=e234faadf42946058f41bd8e7b43408a&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:48.912797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403805-ddbe-4dea-93c8-81671cfab696 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:48.914058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403805-ddbe-4dea-93c8-81671cfab696 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:48.914058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9403805-ddbe-4dea-93c8-81671cfab696 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:48.915323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 611/1220] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:26:48.920415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c1aa5-0f2d-405b-a927-4e74988f0c3c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:48.920809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c1aa5-0f2d-405b-a927-4e74988f0c3c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:48.920973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c1aa5-0f2d-405b-a927-4e74988f0c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:48.937486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-418c1aa5-0f2d-405b-a927-4e74988f0c3c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:26:48.938700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-418c1aa5-0f2d-405b-a927-4e74988f0c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:26:49.005072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 610/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:26:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:26:49.028093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9403805-ddbe-4dea-93c8-81671cfab696 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:49.130702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9403805-ddbe-4dea-93c8-81671cfab696 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:49.165044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20adfe-3664-43fd-9a5d-27eafd8ea245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:49.165765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20adfe-3664-43fd-9a5d-27eafd8ea245 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:49.166070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20adfe-3664-43fd-9a5d-27eafd8ea245 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:49.166345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20adfe-3664-43fd-9a5d-27eafd8ea245 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:49.176280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20adfe-3664-43fd-9a5d-27eafd8ea245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-2f20adfe-3664-43fd-9a5d-27eafd8ea245 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:26:49.184245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:49.185444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:49.186608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 612/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:49.191843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c1aa5-0f2d-405b-a927-4e74988f0c3c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:49.290637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c1aa5-0f2d-405b-a927-4e74988f0c3c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:49.313210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:49.324205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:49.324862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:49.325142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:49.325414 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:49.326186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:49.326489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:49.327840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:49.336212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 611/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:49.342215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20adfe-3664-43fd-9a5d-27eafd8ea245 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:49.384942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:49.441551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20adfe-3664-43fd-9a5d-27eafd8ea245 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:49.475000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:49.475773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:49.476049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:49.476316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:49.487123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:49.488580 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:49.507736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:49.508851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:49.509818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:49.509818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:49.509818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:49.509818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:49.509818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 613/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:49.514858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:49.613307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440bf39-5726-48dc-9790-842075c0f7f2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:49.647036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:49.647905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:49.648182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:49.648453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:49.649167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:49.649469 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:49.650845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:49.662109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 612/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:49.667909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:49.761522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:49.767958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97effd68-7d76-4ff6-b109-bdfa44faa6a1 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:49.804401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:49.805189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:49.805469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:49.805740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:49.812549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:49.813997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:26:49.829118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:49.830882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:49.832850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 614/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:49.836778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:49.884051 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:49.935661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e767f4-38f7-46dc-8dce-660507afc667 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:49.969308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:49.969964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:49.970277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:49.970551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:49.971375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:49.971685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:49.973107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:49.990754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 613/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Wed May 18 22:26:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:49.996345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:50.096761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664aee3-937e-45d6-bf7c-44ccd2c43fcd None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:50.129756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:50.130580 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:50.130862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:50.131135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:50.141616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:50.145067 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:50.160944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:50.162064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:50.163262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:50.163262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:50.163262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:50.163262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:50.163262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 615/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:50.168001 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:50.267275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c64df6-5ca5-4681-9838-b52956dbb4e3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:50.269517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:50.300047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:50.300688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:50.300964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:50.301234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:50.301935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:50.302301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:50.304263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:50.315010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 614/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:50.321540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:50.330392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:50.419088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46c8a-44b7-4b01-9ced-4be8eba8eadf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:50.451923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:50.452698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:50.452972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:50.453234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:50.461266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:50.462726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:26:50.476888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:50.477954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:50.479109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 616/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:50.483889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:50.581621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a542aa3-f90a-4d8d-9c76-472af5a9b377 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:50.614394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660ca2-9558-4a4e-bd68-1abe31aa1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:50.615029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660ca2-9558-4a4e-bd68-1abe31aa1bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:50.615306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660ca2-9558-4a4e-bd68-1abe31aa1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:50.615579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660ca2-9558-4a4e-bd68-1abe31aa1bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:50.616479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee660ca2-9558-4a4e-bd68-1abe31aa1bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:50.616782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee660ca2-9558-4a4e-bd68-1abe31aa1bc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:50.618220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee660ca2-9558-4a4e-bd68-1abe31aa1bc9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:50.629739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 615/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:50.636495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:50.700948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:50.734602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f849bc2-85ae-4289-a11e-639780e7f4b9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:50.767107 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2442774-bf46-4bc5-bb95-dccd8d91b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:50.767977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442774-bf46-4bc5-bb95-dccd8d91b540 None admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:50.768250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442774-bf46-4bc5-bb95-dccd8d91b540 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:50.768578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2442774-bf46-4bc5-bb95-dccd8d91b540 None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/e234faadf42946058f41bd8e7b43408a/roles/5959b7a9b03c486fb50a3eafef4d3baf` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:50.784511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2442774-bf46-4bc5-bb95-dccd8d91b540 None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=e234faadf42946058f41bd8e7b43408a, role_id=5959b7a9b03c486fb50a3eafef4d3baf)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:50.786774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2442774-bf46-4bc5-bb95-dccd8d91b540 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:50.878630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 617/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:26:50 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/e234faadf42946058f41bd8e7b43408a/roles/5959b7a9b03c486fb50a3eafef4d3baf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:26:53.097750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9c538-03f1-43af-b9f1-ce91aeffcf6c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:53.098288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9c538-03f1-43af-b9f1-ce91aeffcf6c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:53.098403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9c538-03f1-43af-b9f1-ce91aeffcf6c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:53.099691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 616/1233] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:26:53.105598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf211f-2f9b-4e7a-95a0-c174c9b79e4d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:53.106076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf211f-2f9b-4e7a-95a0-c174c9b79e4d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:53.106187 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf211f-2f9b-4e7a-95a0-c174c9b79e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:53.122926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b3cf211f-2f9b-4e7a-95a0-c174c9b79e4d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:26:53.124098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b3cf211f-2f9b-4e7a-95a0-c174c9b79e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:26:53.191403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 618/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:26:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:26:53.215171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9c538-03f1-43af-b9f1-ce91aeffcf6c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:53.240122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:53.316611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9c538-03f1-43af-b9f1-ce91aeffcf6c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:53.349768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efece0-8b0a-431b-891e-0d4a3fb1050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:53.351135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efece0-8b0a-431b-891e-0d4a3fb1050b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:53.351496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efece0-8b0a-431b-891e-0d4a3fb1050b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:53.351769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efece0-8b0a-431b-891e-0d4a3fb1050b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:53.361397 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efece0-8b0a-431b-891e-0d4a3fb1050b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-12efece0-8b0a-431b-891e-0d4a3fb1050b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:26:53.369549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:53.375745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:53.376757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 617/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Wed May 18 22:26:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:53.377465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf211f-2f9b-4e7a-95a0-c174c9b79e4d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:53.423834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:53.487651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf211f-2f9b-4e7a-95a0-c174c9b79e4d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:53.521656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:53.522949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:53.523230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:53.523536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:53.524252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:53.524592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:53.525963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:53.534190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 619/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Wed May 18 22:26:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:53.540502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efece0-8b0a-431b-891e-0d4a3fb1050b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:53.624212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:53.640126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efece0-8b0a-431b-891e-0d4a3fb1050b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:53.672917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:53.673706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:53.674059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:53.674541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:53.685254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:53.686703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:53.704194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:53.705317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:53.706313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:53.706313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:53.706313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:53.706313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:53.706313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 618/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:53.711790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:53.809666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea2448-9989-4924-ad2d-e117dec728c9 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:53.819531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:53.844002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:53.844649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:53.844956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:53.845324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:53.846417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:53.846815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:53.848176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:53.859550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 620/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:53.865581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:53.965477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f34499-4bfd-4e1e-a72d-5fa67bf01925 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:53.998660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:53.999437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:53.999709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:53.999975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:54.002601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:54.008250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:54.009660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:26:54.023465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:54.025142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:54.026275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 619/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:54.032142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:54.139190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febafef-9d1f-47d5-8432-f4c56ba2ae52 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:54.171683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:54.172340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:54.172616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:54.172884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:54.173701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:54.174075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:54.175540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:54.193261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 621/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Wed May 18 22:26:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:54.199907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:54.298091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6baff-da02-40fe-bd9a-006c467036b4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:54.331036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8221f49-d68d-4e26-a77f-27a7ac1fe6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:54.331662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8221f49-d68d-4e26-a77f-27a7ac1fe6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:54.331939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8221f49-d68d-4e26-a77f-27a7ac1fe6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:54.332207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8221f49-d68d-4e26-a77f-27a7ac1fe6b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:54.392131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:54.398568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8221f49-d68d-4e26-a77f-27a7ac1fe6b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:54.399975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8221f49-d68d-4e26-a77f-27a7ac1fe6b8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:54.493847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 620/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:26:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 22:26:54.499579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:54.527349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:54.597489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870bcb-286d-40bc-b777-b9bbe1eaa0a4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:54.631153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:54.632626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:54.632908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:54.633180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:54.643918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:54.645360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:54.664676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:54.665770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:54.666778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:54.666778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:54.666778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:54.666778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:54.666778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 622/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:54.671519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8221f49-d68d-4e26-a77f-27a7ac1fe6b8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:54.764842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:54.771022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8221f49-d68d-4e26-a77f-27a7ac1fe6b8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:54.804744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:54.805392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:54.805671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:54.805941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:54.806686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:54.806985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:54.808358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:54.820036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 621/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:54.825876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:54.900949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:54.921056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcce7e-59d8-44ed-b6df-fb82b444a1d4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:54.954243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:54.955011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:54.955286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:54.955553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:54.962165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:54.963600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:26:54.977205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:54.978299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:54.979453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 623/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:54.984472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:55.086477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb341d-2cf9-416d-b116-70cc77fcc5dd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:55.120119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49553f5b-1351-4a87-9fc1-3c6d61feb8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:55.120861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553f5b-1351-4a87-9fc1-3c6d61feb8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:55.121137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553f5b-1351-4a87-9fc1-3c6d61feb8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:55.121405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553f5b-1351-4a87-9fc1-3c6d61feb8f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:55.122203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49553f5b-1351-4a87-9fc1-3c6d61feb8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:55.122554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49553f5b-1351-4a87-9fc1-3c6d61feb8f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:55.123989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49553f5b-1351-4a87-9fc1-3c6d61feb8f7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:55.135674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 622/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:26:55.141886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:55.243283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9d808-eb44-407b-873d-cb3fa0f5aaf7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:55.275736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf6aa2-4df4-47f9-9433-cb20e56d30b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:55.276367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf6aa2-4df4-47f9-9433-cb20e56d30b8 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:55.276647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf6aa2-4df4-47f9-9433-cb20e56d30b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:55.276918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf6aa2-4df4-47f9-9433-cb20e56d30b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:55.277735 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf6aa2-4df4-47f9-9433-cb20e56d30b8 None admin] RBAC: Adding query filter params (role.id=5959b7a9b03c486fb50a3eafef4d3baf, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=e234faadf42946058f41bd8e7b43408a) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:55.278069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf6aa2-4df4-47f9-9433-cb20e56d30b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:55.279541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf6aa2-4df4-47f9-9433-cb20e56d30b8 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:55.285353 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 624/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:26:55 2022] GET /identity/v3/role_assignments?user.id=e234faadf42946058f41bd8e7b43408a&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=5959b7a9b03c486fb50a3eafef4d3baf => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:57.563117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2693-1fcc-47e3-8c71-c05e39c874ff None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:57.563687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2693-1fcc-47e3-8c71-c05e39c874ff None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:57.563687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2693-1fcc-47e3-8c71-c05e39c874ff None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:57.565056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 623/1247] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:26:57.571004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe050241-02df-4d79-8db7-9da9f5cce356 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:57.571411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe050241-02df-4d79-8db7-9da9f5cce356 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:57.571553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe050241-02df-4d79-8db7-9da9f5cce356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:57.576593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:57.588861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fe050241-02df-4d79-8db7-9da9f5cce356 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:26:57.590124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fe050241-02df-4d79-8db7-9da9f5cce356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:26:57.655246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 625/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:26:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 22:26:57.677984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2693-1fcc-47e3-8c71-c05e39c874ff None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:57.697515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:57.781455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2693-1fcc-47e3-8c71-c05e39c874ff None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:57.815977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbba5a-7e0c-43d3-8e62-c0f455c1fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:57.816690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbba5a-7e0c-43d3-8e62-c0f455c1fc90 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:57.816962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbba5a-7e0c-43d3-8e62-c0f455c1fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:57.817225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbba5a-7e0c-43d3-8e62-c0f455c1fc90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:57.827647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbba5a-7e0c-43d3-8e62-c0f455c1fc90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b6dbba5a-7e0c-43d3-8e62-c0f455c1fc90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:26:57.835296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:57.836420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:57.837384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 624/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:26:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:57.842793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe050241-02df-4d79-8db7-9da9f5cce356 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:57.939101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe050241-02df-4d79-8db7-9da9f5cce356 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:57.968288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:57.973052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:57.973704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:57.974016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:57.974317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:57.975110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:57.975659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:57.977069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:57.985745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 626/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:26:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:57.991943 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbba5a-7e0c-43d3-8e62-c0f455c1fc90 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:58.074231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:58.096729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbba5a-7e0c-43d3-8e62-c0f455c1fc90 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:58.130162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:58.130946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:58.131228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:58.131635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:58.141724 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:58.144632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:58.159977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:58.161084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:58.162275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:58.162275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:58.162275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:58.162275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:58.162275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 625/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:58.167829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:58.266646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051b6e0-b06d-43f8-85a7-e40b44252d10 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:58.299334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:58.300043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:58.300311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:58.300577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:58.301279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:58.301581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:58.302958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:58.316073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 627/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:58.321758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:58.419924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3f3b9-216b-414b-ab07-fb257ae1f689 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:58.445672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:58.453452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:58.454311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:58.454565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:58.461273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:58.462826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:58.464249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:26:58.479466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:58.480477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 22:26:58.481500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:26:58.485580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 626/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:58.486524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:58.542240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:58.585488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e28d87-cf50-40a3-80b8-48249dfe76a4 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:58.619406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:58.620071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:58.620358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:58.620634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:58.621462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:58.621770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:58.623228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:58.639813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 628/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Wed May 18 22:26:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:26:58.645467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:58.746786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c25f31-2bdf-4588-8429-2efac18e09d1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:58.779408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74354-2599-4ab3-9782-cc2bd82b34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:58.780043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74354-2599-4ab3-9782-cc2bd82b34ef None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:58.780376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74354-2599-4ab3-9782-cc2bd82b34ef None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:58.780649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a74354-2599-4ab3-9782-cc2bd82b34ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:58.835321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:58.847311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74354-2599-4ab3-9782-cc2bd82b34ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:58.848746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a74354-2599-4ab3-9782-cc2bd82b34ef None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:58.945142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 627/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:26:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 22:26:58.950932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:59.047332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cae2ce-3f1b-4e76-8969-bcc8f91c902b None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:59.060876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:59.082554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:59.083434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:59.083679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:59.083952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:59.094471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:59.096061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:26:59.113672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:59.114774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:59.115938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:26:59.115938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:26:59.115938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:26:59.115938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:59.116856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 629/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:59.120794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74354-2599-4ab3-9782-cc2bd82b34ef None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:59.209200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:59.221175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a74354-2599-4ab3-9782-cc2bd82b34ef None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:59.254197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:59.254839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:59.255115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:59.255384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:59.256138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:59.257219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:59.258597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:59.269357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 628/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:59.275306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:59.375394 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc15c3-5bb3-45f9-b6c3-f6d8832f8bfc None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:59.409774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:59.410558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:59.410838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:59.411113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:59.417677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:59.419167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:26:59.433506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:26:59.434652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:26:59.435961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 630/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:26:59.440912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:59.543912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906f18b-5847-4c82-837f-9810b0c2b584 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:59.578568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f1d3c-d4f8-4313-aff5-1af31b594c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:59.579226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1d3c-d4f8-4313-aff5-1af31b594c96 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:59.579511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1d3c-d4f8-4313-aff5-1af31b594c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:59.579794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f1d3c-d4f8-4313-aff5-1af31b594c96 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:59.580575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f1d3c-d4f8-4313-aff5-1af31b594c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:59.580884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f1d3c-d4f8-4313-aff5-1af31b594c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:59.582420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f1d3c-d4f8-4313-aff5-1af31b594c96 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:59.594372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 629/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:26:59.601180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:26:59.626961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:26:59.701039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692eacf-95fa-4e5c-80ca-254892b3d1a6 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:26:59.735480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0c41b-1c10-4ffd-8090-4cd9eed60b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:26:59.736118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c41b-1c10-4ffd-8090-4cd9eed60b1a None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:26:59.736396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c41b-1c10-4ffd-8090-4cd9eed60b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:26:59.736667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0c41b-1c10-4ffd-8090-4cd9eed60b1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:26:59.737488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0c41b-1c10-4ffd-8090-4cd9eed60b1a None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=e234faadf42946058f41bd8e7b43408a) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:26:59.737794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0c41b-1c10-4ffd-8090-4cd9eed60b1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:26:59.739261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0c41b-1c10-4ffd-8090-4cd9eed60b1a None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:26:59.745211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 631/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:26:59 2022] GET /identity/v3/role_assignments?user.id=e234faadf42946058f41bd8e7b43408a&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=fe643140d2134736a54afd972d47d43f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:01.936052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa25ff5-2a4e-4d94-9509-6e5b77a08628 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:01.936601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa25ff5-2a4e-4d94-9509-6e5b77a08628 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:01.936601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa25ff5-2a4e-4d94-9509-6e5b77a08628 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:01.937940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 630/1261] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:27:01.943281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871bf1-b31f-4389-b38b-7e18598589ad None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:01.943672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871bf1-b31f-4389-b38b-7e18598589ad None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:01.944542 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871bf1-b31f-4389-b38b-7e18598589ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:01.962108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fe871bf1-b31f-4389-b38b-7e18598589ad None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:27:01.963286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fe871bf1-b31f-4389-b38b-7e18598589ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:27:02.030889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 632/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:27:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:27:02.053657 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa25ff5-2a4e-4d94-9509-6e5b77a08628 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:02.065229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:02.153284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa25ff5-2a4e-4d94-9509-6e5b77a08628 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:02.186575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aadb4-8538-45e2-bfd9-794ba6491890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:02.187286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aadb4-8538-45e2-bfd9-794ba6491890 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:02.187564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aadb4-8538-45e2-bfd9-794ba6491890 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:02.187834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75aadb4-8538-45e2-bfd9-794ba6491890 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:02.198398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75aadb4-8538-45e2-bfd9-794ba6491890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a75aadb4-8538-45e2-bfd9-794ba6491890 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:27:02.206421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:02.207555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:27:02.208558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 631/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:02.214196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871bf1-b31f-4389-b38b-7e18598589ad None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:02.232436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:02.310052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871bf1-b31f-4389-b38b-7e18598589ad None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:02.344355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:02.345006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:02.345281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:02.345549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:02.346476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:02.346777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:02.348135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:02.356898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 633/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:27:02.363177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aadb4-8538-45e2-bfd9-794ba6491890 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:02.431540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:02.466081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75aadb4-8538-45e2-bfd9-794ba6491890 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:02.498872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:02.499738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:02.499993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:02.500265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:02.511652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:02.513073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:27:02.530810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:02.531758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:02.532714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:27:02.532714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:27:02.532714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:27:02.532714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:27:02.532714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 632/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:02.538489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:02.619943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:02.638580 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b344f-8243-4bba-a86a-092ff6d47058 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:02.671880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:02.672521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:02.672802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:02.673074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:02.673784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:02.674114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:02.675472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:02.687898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 634/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:02.694215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:02.793972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71963f-b12e-4bd9-871b-2bee1d3ae56e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:02.813467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:02.827583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:02.828369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:02.828646 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:02.828913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:02.836458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:02.837888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:27:02.852354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:02.853517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:27:02.855003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 633/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:27:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:02.859275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:02.955888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ae05f-fa8c-45e3-aae2-6f38d8bc17cf None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:02.989572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:02.990257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:02.990540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:02.990940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:02.991770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:02.992079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:02.993501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:03.002433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:03.010350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 635/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Wed May 18 22:27:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:03.016025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:03.114256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53f7da-45df-4bed-89ab-d01fbfb4be9c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:03.147532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:03.148392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:03.148672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:03.148941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:03.159190 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:03.160641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:27:03.177880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:03.179006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:03.180212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:27:03.180212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:27:03.180212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:27:03.180212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:27:03.180212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 634/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 22:27:03.185374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:03.283973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c363e3d-758d-41ae-9a5a-a903ddb61a7d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:03.317548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b354-781a-4425-8408-534482361efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:03.318163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b354-781a-4425-8408-534482361efb None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:03.318444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b354-781a-4425-8408-534482361efb None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:03.319217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b354-781a-4425-8408-534482361efb None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:03.319941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b354-781a-4425-8408-534482361efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:03.320287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b354-781a-4425-8408-534482361efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:03.321716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b354-781a-4425-8408-534482361efb None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:03.335515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 636/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:03.341326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:03.372376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:03.441092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00017a7-2672-4675-a186-f3c518d85e96 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:03.476150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:03.476929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:03.477209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:03.477483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:03.483956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:03.485378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:27:03.500079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:03.501255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:27:03.502272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 635/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:03.508059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b354-781a-4425-8408-534482361efb None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:03.566871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:03.608999 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b354-781a-4425-8408-534482361efb None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:03.642441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e5b99-0e63-40f9-be80-df4be0b1dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:03.643088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5b99-0e63-40f9-be80-df4be0b1dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:03.643369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5b99-0e63-40f9-be80-df4be0b1dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:03.643637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5b99-0e63-40f9-be80-df4be0b1dbd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:03.644411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e5b99-0e63-40f9-be80-df4be0b1dbd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:03.644715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e5b99-0e63-40f9-be80-df4be0b1dbd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:03.646155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e5b99-0e63-40f9-be80-df4be0b1dbd1 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:03.659056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 637/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:03.665335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:03.755693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:03.764726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c02a4-12ec-40e8-8ed1-6447018b0a17 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:03.796753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee480f3-aa76-4815-ae71-7ddc07a374fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:03.797620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee480f3-aa76-4815-ae71-7ddc07a374fc None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:03.797893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee480f3-aa76-4815-ae71-7ddc07a374fc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:03.798194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee480f3-aa76-4815-ae71-7ddc07a374fc None admin] PATH_INFO: `/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/e234faadf42946058f41bd8e7b43408a/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:03.800086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee480f3-aa76-4815-ae71-7ddc07a374fc None admin] RBAC: Authorizing `identity:create_grant(project_id=af0e8152e18c4e6a9f392bddbbfbc166, user_id=e234faadf42946058f41bd8e7b43408a, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:03.801519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee480f3-aa76-4815-ae71-7ddc07a374fc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:03.860775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 636/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Wed May 18 22:27:03 2022] PUT /identity/v3/projects/af0e8152e18c4e6a9f392bddbbfbc166/users/e234faadf42946058f41bd8e7b43408a/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:27:06.063605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbbad2-5e2c-4692-97af-568abed3ea55 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:06.064099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbbad2-5e2c-4692-97af-568abed3ea55 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:06.064209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbbad2-5e2c-4692-97af-568abed3ea55 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:06.065773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 638/1274] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:27:06.071785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8a41a-26f7-4065-b772-df31a4d3fe3e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:06.072190 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8a41a-26f7-4065-b772-df31a4d3fe3e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:06.072330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8a41a-26f7-4065-b772-df31a4d3fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:06.088054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6fd8a41a-26f7-4065-b772-df31a4d3fe3e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:27:06.089233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6fd8a41a-26f7-4065-b772-df31a4d3fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:27:06.155429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 637/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:27:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:27:06.179158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbbad2-5e2c-4692-97af-568abed3ea55 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:06.279449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbbad2-5e2c-4692-97af-568abed3ea55 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:06.296420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:06.313441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420fe50-4790-4a42-b264-1563c43bd5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:06.314258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420fe50-4790-4a42-b264-1563c43bd5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:06.314537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420fe50-4790-4a42-b264-1563c43bd5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:06.314810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420fe50-4790-4a42-b264-1563c43bd5c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:06.325815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420fe50-4790-4a42-b264-1563c43bd5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-d420fe50-4790-4a42-b264-1563c43bd5c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 22:27:06.333604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:06.334965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:06.335993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 639/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Wed May 18 22:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:06.340915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8a41a-26f7-4065-b772-df31a4d3fe3e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:06.422200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:06.440030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8a41a-26f7-4065-b772-df31a4d3fe3e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:06.472495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:06.473142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:06.473417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:06.473688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:06.474694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:06.474789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:06.476600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:06.484387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 638/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Wed May 18 22:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:06.490215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420fe50-4790-4a42-b264-1563c43bd5c3 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:06.588821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420fe50-4790-4a42-b264-1563c43bd5c3 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:06.623528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:06.624346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:06.624624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:06.624895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:06.635622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:06.637097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:27:06.653773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:06.657632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:06.658784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:27:06.658784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:27:06.658784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:27:06.658784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:06.658784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 640/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:06.660813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:06.759145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cc555-cce0-490d-975e-8083f255d87a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:06.791990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:06.792642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:06.792919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:06.793188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:06.793892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:06.794218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:06.795556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:06.806845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 639/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:06.812677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:06.843501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:06.910461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb145e-520f-4f23-9cd3-87ce569f9d9d None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:06.943916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:06.944788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:06.945064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:06.945333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:06.952287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:06.953724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 22:27:06.968795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:06.969943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:06.971178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 641/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:27:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:06.976888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:06.980658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:07.076521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cf666-fa0b-4ec3-863e-bb9f355fe051 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:07.110642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:07.110889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:07.111161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:07.111433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:07.112252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:07.112557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:07.113955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:07.130699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 640/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Wed May 18 22:27:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:07.137102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:07.225491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:07.234363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71ca7a-d174-4366-b31c-e381dda556a7 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:07.266581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986ea97-ef88-4c42-9694-54587e85b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:07.267199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986ea97-ef88-4c42-9694-54587e85b8ef None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:07.267475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986ea97-ef88-4c42-9694-54587e85b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:07.267743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986ea97-ef88-4c42-9694-54587e85b8ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:07.336578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986ea97-ef88-4c42-9694-54587e85b8ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:07.338077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986ea97-ef88-4c42-9694-54587e85b8ef None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:07.424363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:07.435600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 642/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Wed May 18 22:27:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 22:27:07.441791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:07.504293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:07.544398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5a3ea-3bb7-4c27-b5a6-3ba0dd4d3430 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:07.577426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:07.578233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:07.578508 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:07.578774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:07.589027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:07.590606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 22:27:07.608573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:07.614313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:07.615278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 22:27:07.615278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 22:27:07.615278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 22:27:07.615278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:27:07.615278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 641/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:07.616775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986ea97-ef88-4c42-9694-54587e85b8ef None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:07.714758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986ea97-ef88-4c42-9694-54587e85b8ef None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:07.748116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:07.748768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:07.749050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:07.749323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:07.750054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:07.750369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:07.751746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:07.762624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 643/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Wed May 18 22:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:07.768209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:07.867958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8bcc3-e47b-4d01-8502-808e85c4c5d2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:07.882933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:07.903038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:07.903820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:07.904111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:07.904381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:07.910846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:07.912273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 22:27:07.925618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:07.926694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: ERROR keystone.server.flask.application May 18 22:27:07.928028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 642/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Wed May 18 22:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:07.932837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:07.983424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:08.032267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8f52-a187-4f14-808d-5bac9096d916 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:08.065787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34a02b-5cd5-4e78-a51e-e2aa657475bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:08.066595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a02b-5cd5-4e78-a51e-e2aa657475bf None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:08.066877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a02b-5cd5-4e78-a51e-e2aa657475bf None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:08.067151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a02b-5cd5-4e78-a51e-e2aa657475bf None admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:08.067919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34a02b-5cd5-4e78-a51e-e2aa657475bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:08.068222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34a02b-5cd5-4e78-a51e-e2aa657475bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:08.070235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34a02b-5cd5-4e78-a51e-e2aa657475bf None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:08.082198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 644/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Wed May 18 22:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:08.088998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:08.188962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7703656-f3dd-4d08-930b-755ed2a8adf8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:08.223269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547b548-bcb2-48cb-a850-1f5c2da82a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:08.223907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b548-bcb2-48cb-a850-1f5c2da82a9a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:08.224189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b548-bcb2-48cb-a850-1f5c2da82a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:08.224465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547b548-bcb2-48cb-a850-1f5c2da82a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:08.225348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547b548-bcb2-48cb-a850-1f5c2da82a9a None admin] RBAC: Adding query filter params (role.id=fe643140d2134736a54afd972d47d43f, scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166, user.id=e234faadf42946058f41bd8e7b43408a) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:08.225651 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547b548-bcb2-48cb-a850-1f5c2da82a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:08.227095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547b548-bcb2-48cb-a850-1f5c2da82a9a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:08.232845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 643/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Wed May 18 22:27:08 2022] GET /identity/v3/role_assignments?user.id=e234faadf42946058f41bd8e7b43408a&scope.project.id=af0e8152e18c4e6a9f392bddbbfbc166&role.id=fe643140d2134736a54afd972d47d43f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:10.439850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2245d6-714c-4bb5-9725-934baf2957a0 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:10.440728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2245d6-714c-4bb5-9725-934baf2957a0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:10.440728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2245d6-714c-4bb5-9725-934baf2957a0 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:10.442127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 645/1288] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:27:10.447947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac299c-2daf-47f6-951e-ff5f669a4200 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:10.448409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac299c-2daf-47f6-951e-ff5f669a4200 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:10.448518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac299c-2daf-47f6-951e-ff5f669a4200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:10.465030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-16ac299c-2daf-47f6-951e-ff5f669a4200 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:27:10.470501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-16ac299c-2daf-47f6-951e-ff5f669a4200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:27:10.495100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:10.530794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 644/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:27:10.552395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2245d6-714c-4bb5-9725-934baf2957a0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:10.653652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2245d6-714c-4bb5-9725-934baf2957a0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:10.664237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:10.687033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:10.688058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:10.689124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:10.689124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:10.689732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:10.691850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:10.704945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:10.706296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:10.707423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 646/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:27:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:10.712974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac299c-2daf-47f6-951e-ff5f669a4200 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:10.810192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac299c-2daf-47f6-951e-ff5f669a4200 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:10.844102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a597c7c-7213-4d78-af89-4c216131d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:10.844751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a597c7c-7213-4d78-af89-4c216131d777 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:10.845031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a597c7c-7213-4d78-af89-4c216131d777 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:10.845305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a597c7c-7213-4d78-af89-4c216131d777 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:10.846032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a597c7c-7213-4d78-af89-4c216131d777 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:10.846337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a597c7c-7213-4d78-af89-4c216131d777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:10.847689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a597c7c-7213-4d78-af89-4c216131d777 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:10.852623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 645/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Wed May 18 22:27:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:10.858481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:10.957472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814593c-3f6c-4798-8990-89ffa7805b65 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:10.990078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aed82-c4f3-4dcb-b9af-cf346d31d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:10.990805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aed82-c4f3-4dcb-b9af-cf346d31d010 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:10.991081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aed82-c4f3-4dcb-b9af-cf346d31d010 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:10.991352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aed82-c4f3-4dcb-b9af-cf346d31d010 None admin] PATH_INFO: `/v3/services` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:10.992042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aed82-c4f3-4dcb-b9af-cf346d31d010 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:10.992341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aed82-c4f3-4dcb-b9af-cf346d31d010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:10.993693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aed82-c4f3-4dcb-b9af-cf346d31d010 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:10.998073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 647/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Wed May 18 22:27:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:13.175137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7d54-08cc-4071-8d34-3ac3a42c14e5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:13.175692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7d54-08cc-4071-8d34-3ac3a42c14e5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:13.175692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7d54-08cc-4071-8d34-3ac3a42c14e5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:13.177030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 646/1293] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:27:13.183051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c8a6-d827-414a-9f78-d5c085dae5b4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:13.183496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c8a6-d827-414a-9f78-d5c085dae5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:13.183598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c8a6-d827-414a-9f78-d5c085dae5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:13.200444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0f38c8a6-d827-414a-9f78-d5c085dae5b4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:27:13.201621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0f38c8a6-d827-414a-9f78-d5c085dae5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:27:13.231362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:13.267677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 648/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:27:13.290925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7d54-08cc-4071-8d34-3ac3a42c14e5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:13.321933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:13.392303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7d54-08cc-4071-8d34-3ac3a42c14e5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:13.425475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a25073-9876-4859-9441-30c696ecfbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:13.426330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25073-9876-4859-9441-30c696ecfbb9 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:13.433061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25073-9876-4859-9441-30c696ecfbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:13.433061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25073-9876-4859-9441-30c696ecfbb9 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:13.433061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a25073-9876-4859-9441-30c696ecfbb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:13.433061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a25073-9876-4859-9441-30c696ecfbb9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:13.524790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 647/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Wed May 18 22:27:13 2022] POST /identity/v3/services => generated 246 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:27:15.758242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bac30-1014-4b96-9d2c-160e5355e1a5 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:15.758860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bac30-1014-4b96-9d2c-160e5355e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:15.758860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bac30-1014-4b96-9d2c-160e5355e1a5 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:15.760130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 649/1296] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:27:15.765431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c00c3-673d-4d11-89bd-380850ed77d1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:15.769550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c00c3-673d-4d11-89bd-380850ed77d1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:15.769550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c00c3-673d-4d11-89bd-380850ed77d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:15.783323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4b0c00c3-673d-4d11-89bd-380850ed77d1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:27:15.784501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4b0c00c3-673d-4d11-89bd-380850ed77d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:27:15.856704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 648/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:27:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:27:15.879150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bac30-1014-4b96-9d2c-160e5355e1a5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:15.979036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bac30-1014-4b96-9d2c-160e5355e1a5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:16.011776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:16.012507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:16.012783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:16.013052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:16.013692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:16.015124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:16.027704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:16.033775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:16.034934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 650/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:27:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:16.036003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c00c3-673d-4d11-89bd-380850ed77d1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:16.053794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:16.134819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c00c3-673d-4d11-89bd-380850ed77d1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:16.168367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:16.169020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:16.169293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:16.169560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:16.170277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:16.170575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:16.172056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:16.177212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 649/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Wed May 18 22:27:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:27:16.183449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:16.215779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:16.284391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafdc04-053e-4535-85d2-f513f2c5ae2f None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:16.317596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced334d-89c4-4b65-bc4f-0b164d323a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:16.318984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced334d-89c4-4b65-bc4f-0b164d323a2c None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:16.319209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced334d-89c4-4b65-bc4f-0b164d323a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:16.319486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced334d-89c4-4b65-bc4f-0b164d323a2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:16.320281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced334d-89c4-4b65-bc4f-0b164d323a2c None admin] RBAC: Adding query filter params (interface=public, service_id=3f0b19750f43412ea4f1d4d1f775ac6d, region_id=RegionOne) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:16.320592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced334d-89c4-4b65-bc4f-0b164d323a2c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:16.321995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced334d-89c4-4b65-bc4f-0b164d323a2c None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:16.326986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 651/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Wed May 18 22:27:16 2022] GET /identity/v3/endpoints?service_id=3f0b19750f43412ea4f1d4d1f775ac6d&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:16.332680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:16.414634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:16.432361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28816e26-9e73-40a2-94fe-066bbb88d978 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:16.464717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed7866-1772-4d99-8f7c-91faab3bb394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:16.465410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed7866-1772-4d99-8f7c-91faab3bb394 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:16.465684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed7866-1772-4d99-8f7c-91faab3bb394 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:16.465954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed7866-1772-4d99-8f7c-91faab3bb394 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:16.466653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed7866-1772-4d99-8f7c-91faab3bb394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:16.467993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed7866-1772-4d99-8f7c-91faab3bb394 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:16.474684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 650/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Wed May 18 22:27:16 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:27:18.696470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca78b0-2eed-47af-b43f-074e2072b43d None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:18.697045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca78b0-2eed-47af-b43f-074e2072b43d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:18.697045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca78b0-2eed-47af-b43f-074e2072b43d None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:18.698399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 652/1302] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:27:18.703622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70933fc9-5c97-4e10-bc3e-05a10a63a992 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:18.704065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70933fc9-5c97-4e10-bc3e-05a10a63a992 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:18.704199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70933fc9-5c97-4e10-bc3e-05a10a63a992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:18.720504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-70933fc9-5c97-4e10-bc3e-05a10a63a992 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:27:18.721670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-70933fc9-5c97-4e10-bc3e-05a10a63a992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:27:18.787326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 651/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:27:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 22:27:18.810441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca78b0-2eed-47af-b43f-074e2072b43d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:18.902873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:18.909433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca78b0-2eed-47af-b43f-074e2072b43d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:18.942925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:18.944310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:18.944584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:18.944855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:18.945517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:18.946981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 22:27:18.958487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 22:27:18.959862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.get_or_create( May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application with Lock( May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self._enter() May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application return self.creator() May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application created_value = creator( May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: ERROR keystone.server.flask.application May 18 22:27:18.960943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 653/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Wed May 18 22:27:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 22:27:18.965801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70933fc9-5c97-4e10-bc3e-05a10a63a992 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:19.042827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:19.066343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70933fc9-5c97-4e10-bc3e-05a10a63a992 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:19.098801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ff6cc-3971-409e-be80-c98b08943084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:19.099435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ff6cc-3971-409e-be80-c98b08943084 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:19.100781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ff6cc-3971-409e-be80-c98b08943084 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:19.101064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ff6cc-3971-409e-be80-c98b08943084 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:19.101763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ff6cc-3971-409e-be80-c98b08943084 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:27:19.102094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ff6cc-3971-409e-be80-c98b08943084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:19.111434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ff6cc-3971-409e-be80-c98b08943084 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:19.111434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 652/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Wed May 18 22:27:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:27:19.114271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:27:19.213522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b598e-fcca-454b-98a8-41bd088d9073 None admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:27:19.247470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8da632-152a-4feb-9455-e0b30678dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:27:19.248121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da632-152a-4feb-9455-e0b30678dbb5 None admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:27:19.248401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da632-152a-4feb-9455-e0b30678dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:27:19.248674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da632-152a-4feb-9455-e0b30678dbb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:27:19.249412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8da632-152a-4feb-9455-e0b30678dbb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:27:19.250806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8da632-152a-4feb-9455-e0b30678dbb5 None admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:27:19.300599 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 654/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Wed May 18 22:27:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:27:29.129628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=30 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:27:29.296034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:39.491043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527eb92-29d3-48f3-99fd-f87ca89127dd None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:39.492602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527eb92-29d3-48f3-99fd-f87ca89127dd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:39.493131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527eb92-29d3-48f3-99fd-f87ca89127dd None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:39.500038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10196c8-045b-41cd-b65c-f9a6ea507165 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:39.500915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10196c8-045b-41cd-b65c-f9a6ea507165 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:39.501421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10196c8-045b-41cd-b65c-f9a6ea507165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:39.505360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 653/1307] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:32:39 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:39.625008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b10196c8-045b-41cd-b65c-f9a6ea507165 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:39.629908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b10196c8-045b-41cd-b65c-f9a6ea507165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:39.817108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 655/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:32:39.873857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a045-6b0c-4fc6-b3ef-ebaf1a39ccd2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:39.873857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a045-6b0c-4fc6-b3ef-ebaf1a39ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:39.873857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a045-6b0c-4fc6-b3ef-ebaf1a39ccd2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:39.873857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 654/1309] 10.222.0.70 () {54 vars in 964 bytes} [Wed May 18 22:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:39.875130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5370277-5a5b-4cc5-ab10-fb502edede56 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:39.875530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5370277-5a5b-4cc5-ab10-fb502edede56 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:39.875823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5370277-5a5b-4cc5-ab10-fb502edede56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:39.962799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c5370277-5a5b-4cc5-ab10-fb502edede56 None None] MFA Rules not processed for user `47783bb7d4cc41c6ac4c1adb682b093b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:39.964167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c5370277-5a5b-4cc5-ab10-fb502edede56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:39.986649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:40.051027 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 656/1310] 10.222.0.70 () {58 vars in 1061 bytes} [Wed May 18 22:32:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:32:40.064769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a045-6b0c-4fc6-b3ef-ebaf1a39ccd2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:32:40.066612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-08c3a045-6b0c-4fc6-b3ef-ebaf1a39ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:40.196859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a045-6b0c-4fc6-b3ef-ebaf1a39ccd2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:32:40.289346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a3784-513b-45a6-a7d3-1e20e9db8661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:32:40.290079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3784-513b-45a6-a7d3-1e20e9db8661 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:40.290366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3784-513b-45a6-a7d3-1e20e9db8661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:40.290643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a3784-513b-45a6-a7d3-1e20e9db8661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:40.292446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e54a3784-513b-45a6-a7d3-1e20e9db8661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:40.359953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:40.426898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a3784-513b-45a6-a7d3-1e20e9db8661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:32:40.428379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a3784-513b-45a6-a7d3-1e20e9db8661 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:32:40.451736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 655/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:32:43.003133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd122ee-dca1-4c1e-ba22-909093437585 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:43.003642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd122ee-dca1-4c1e-ba22-909093437585 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:43.003726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd122ee-dca1-4c1e-ba22-909093437585 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:43.005245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 657/1312] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:43.010703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb2de-9f83-4b62-86e2-393767887231 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:43.011149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb2de-9f83-4b62-86e2-393767887231 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:43.011232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbb2de-9f83-4b62-86e2-393767887231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:43.093597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fdcbb2de-9f83-4b62-86e2-393767887231 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:43.094932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fdcbb2de-9f83-4b62-86e2-393767887231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:43.196978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 656/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:32:43.235099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd122ee-dca1-4c1e-ba22-909093437585 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:32:43.237078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2dd122ee-dca1-4c1e-ba22-909093437585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:43.346221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd122ee-dca1-4c1e-ba22-909093437585 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:32:43.422509 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:43.426100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6982f5e-9023-4cfc-b970-00cd9e91ff5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:32:43.426852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982f5e-9023-4cfc-b970-00cd9e91ff5b service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:43.427234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982f5e-9023-4cfc-b970-00cd9e91ff5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:43.427613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982f5e-9023-4cfc-b970-00cd9e91ff5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:43.429372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c6982f5e-9023-4cfc-b970-00cd9e91ff5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:43.545116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6982f5e-9023-4cfc-b970-00cd9e91ff5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:32:43.546701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6982f5e-9023-4cfc-b970-00cd9e91ff5b service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:32:43.565732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 658/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:32:46.353618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623b32-6b52-4d91-81dd-86c36c02dff2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:46.354149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623b32-6b52-4d91-81dd-86c36c02dff2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:46.354149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623b32-6b52-4d91-81dd-86c36c02dff2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:46.355499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 657/1315] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:46.361267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d783ee-c5e0-4bbe-809c-87e027014bde None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:46.361732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d783ee-c5e0-4bbe-809c-87e027014bde None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:46.362074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d783ee-c5e0-4bbe-809c-87e027014bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:46.425121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e3d783ee-c5e0-4bbe-809c-87e027014bde None None] MFA Rules not processed for user `f9a9404845604b45b51c1b5c3c8f05b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:46.426324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e3d783ee-c5e0-4bbe-809c-87e027014bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:46.476995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:46.527498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 659/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:32:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:32:46.568068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623b32-6b52-4d91-81dd-86c36c02dff2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:32:46.569597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d6623b32-6b52-4d91-81dd-86c36c02dff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:46.579384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:46.670516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623b32-6b52-4d91-81dd-86c36c02dff2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:32:46.741362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cfe10-4092-4feb-8896-665488c30808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:32:46.741992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfe10-4092-4feb-8896-665488c30808 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:46.742297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfe10-4092-4feb-8896-665488c30808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:46.742570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfe10-4092-4feb-8896-665488c30808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:46.744187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-225cfe10-4092-4feb-8896-665488c30808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:46.804996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:46.850541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cfe10-4092-4feb-8896-665488c30808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:32:46.851953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cfe10-4092-4feb-8896-665488c30808 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:32:46.869951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 658/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:32:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:32:49.908655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdc6be-7e5d-4574-9fa2-6d1f6200794f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:49.909257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdc6be-7e5d-4574-9fa2-6d1f6200794f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:49.909257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdc6be-7e5d-4574-9fa2-6d1f6200794f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:49.910581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 660/1318] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:49.915831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea781ce-35a0-4d02-ac2e-c7d587c4cfb3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:49.916269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea781ce-35a0-4d02-ac2e-c7d587c4cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:49.916377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea781ce-35a0-4d02-ac2e-c7d587c4cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:49.980125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8ea781ce-35a0-4d02-ac2e-c7d587c4cfb3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:49.981323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8ea781ce-35a0-4d02-ac2e-c7d587c4cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:50.076892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 659/1319] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:32:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:32:50.115360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdc6be-7e5d-4574-9fa2-6d1f6200794f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:32:50.116872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b6bdc6be-7e5d-4574-9fa2-6d1f6200794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:50.219397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdc6be-7e5d-4574-9fa2-6d1f6200794f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:32:50.291447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f604f39-e1fa-4c00-8ead-49e241cbdd74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:32:50.292075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604f39-e1fa-4c00-8ead-49e241cbdd74 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:50.292351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604f39-e1fa-4c00-8ead-49e241cbdd74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:50.292621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f604f39-e1fa-4c00-8ead-49e241cbdd74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:50.294252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8f604f39-e1fa-4c00-8ead-49e241cbdd74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:50.302088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:50.404549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f604f39-e1fa-4c00-8ead-49e241cbdd74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:32:50.406058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f604f39-e1fa-4c00-8ead-49e241cbdd74 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:32:50.424564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 661/1320] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:32:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:32:53.606677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6f2e-6640-45f3-84a1-6a44e56a2927 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:53.607233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6f2e-6640-45f3-84a1-6a44e56a2927 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:53.607233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef6f2e-6640-45f3-84a1-6a44e56a2927 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:53.608575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 660/1321] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:53.614627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1d99-e5f1-439a-98c2-6fddd3a00298 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:53.615076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1d99-e5f1-439a-98c2-6fddd3a00298 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:53.615304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1d99-e5f1-439a-98c2-6fddd3a00298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:53.679365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-eb0b1d99-e5f1-439a-98c2-6fddd3a00298 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:53.680545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-eb0b1d99-e5f1-439a-98c2-6fddd3a00298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:53.737064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:53.776116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 662/1322] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:32:53.826892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378426f-1d41-4f70-8b38-679ffaa50888 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:53.827171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378426f-1d41-4f70-8b38-679ffaa50888 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:53.827445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378426f-1d41-4f70-8b38-679ffaa50888 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:53.829667 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 661/1323] 10.222.0.70 () {54 vars in 964 bytes} [Wed May 18 22:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:53.835583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487033c5-b8ab-4533-a803-5b38bab50d12 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:53.835932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487033c5-b8ab-4533-a803-5b38bab50d12 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:53.836270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487033c5-b8ab-4533-a803-5b38bab50d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:53.911244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-487033c5-b8ab-4533-a803-5b38bab50d12 None None] MFA Rules not processed for user `47783bb7d4cc41c6ac4c1adb682b093b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:53.912428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-487033c5-b8ab-4533-a803-5b38bab50d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:53.988764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 663/1324] 10.222.0.70 () {58 vars in 1061 bytes} [Wed May 18 22:32:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:32:53.997761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378426f-1d41-4f70-8b38-679ffaa50888 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:32:53.999314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e378426f-1d41-4f70-8b38-679ffaa50888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:54.019563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:54.105452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378426f-1d41-4f70-8b38-679ffaa50888 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:32:54.177011 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c755c57-1a0c-45e9-839e-610cbd34dc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:32:54.177657 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755c57-1a0c-45e9-839e-610cbd34dc15 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:54.177933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755c57-1a0c-45e9-839e-610cbd34dc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:54.178252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c755c57-1a0c-45e9-839e-610cbd34dc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:54.179871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4c755c57-1a0c-45e9-839e-610cbd34dc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:54.252133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:54.289739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c755c57-1a0c-45e9-839e-610cbd34dc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:32:54.291207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c755c57-1a0c-45e9-839e-610cbd34dc15 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:32:54.312005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 662/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:32:56.846338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d600-b1dd-4b2c-ae17-58858fd33494 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:56.846884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d600-b1dd-4b2c-ae17-58858fd33494 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:56.846998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d600-b1dd-4b2c-ae17-58858fd33494 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:56.848354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 664/1326] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:56.853813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8ea2-4551-4d37-897f-14c7fdc4a6ca None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:56.854275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8ea2-4551-4d37-897f-14c7fdc4a6ca None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:56.854393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8ea2-4551-4d37-897f-14c7fdc4a6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:56.918954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-18ac8ea2-4551-4d37-897f-14c7fdc4a6ca None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:56.920159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-18ac8ea2-4551-4d37-897f-14c7fdc4a6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:57.018931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 663/1327] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:32:57.055378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356d600-b1dd-4b2c-ae17-58858fd33494 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:32:57.056943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9356d600-b1dd-4b2c-ae17-58858fd33494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:57.117648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:57.160615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356d600-b1dd-4b2c-ae17-58858fd33494 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:32:57.235361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba65bb2-0db3-4994-9409-5fe44ae8d632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:32:57.236015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba65bb2-0db3-4994-9409-5fe44ae8d632 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:57.236291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba65bb2-0db3-4994-9409-5fe44ae8d632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:57.236564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba65bb2-0db3-4994-9409-5fe44ae8d632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:57.238251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1ba65bb2-0db3-4994-9409-5fe44ae8d632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:57.351631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:57.354122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba65bb2-0db3-4994-9409-5fe44ae8d632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:32:57.355782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba65bb2-0db3-4994-9409-5fe44ae8d632 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:32:57.375051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 665/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:32:59.643516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970547eb-541c-463f-b575-5fd2c0e39fc2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:59.644070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970547eb-541c-463f-b575-5fd2c0e39fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:59.644070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970547eb-541c-463f-b575-5fd2c0e39fc2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:59.645403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 664/1329] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:32:59.650691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f0dd-e3ea-434d-9c53-fd01802cb9bf None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:32:59.651105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f0dd-e3ea-434d-9c53-fd01802cb9bf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:32:59.651308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070f0dd-e3ea-434d-9c53-fd01802cb9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:32:59.717664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7070f0dd-e3ea-434d-9c53-fd01802cb9bf None None] MFA Rules not processed for user `f9a9404845604b45b51c1b5c3c8f05b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:32:59.718886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7070f0dd-e3ea-434d-9c53-fd01802cb9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:59.821059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 666/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:32:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:32:59.859101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970547eb-541c-463f-b575-5fd2c0e39fc2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:32:59.861298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-970547eb-541c-463f-b575-5fd2c0e39fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:32:59.892612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:32:59.965399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970547eb-541c-463f-b575-5fd2c0e39fc2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:00.042448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf48417-9ae9-4a7c-9d98-efcd4b5c42c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:00.043099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf48417-9ae9-4a7c-9d98-efcd4b5c42c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:00.043382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf48417-9ae9-4a7c-9d98-efcd4b5c42c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:00.043656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf48417-9ae9-4a7c-9d98-efcd4b5c42c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:00.045333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fdf48417-9ae9-4a7c-9d98-efcd4b5c42c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:00.124616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:00.157522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf48417-9ae9-4a7c-9d98-efcd4b5c42c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:00.158978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf48417-9ae9-4a7c-9d98-efcd4b5c42c3 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:00.176917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 665/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:32:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:02.977538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426076fd-82c3-44bf-8199-242308a6285b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:02.978097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426076fd-82c3-44bf-8199-242308a6285b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:02.978097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426076fd-82c3-44bf-8199-242308a6285b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:02.979527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 667/1332] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:02.985767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2ab14-babc-4738-8260-a4202506d01b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:02.986341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2ab14-babc-4738-8260-a4202506d01b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:02.986341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2ab14-babc-4738-8260-a4202506d01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:03.055339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0bd2ab14-babc-4738-8260-a4202506d01b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:03.056564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0bd2ab14-babc-4738-8260-a4202506d01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:03.154744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 666/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:03.191342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426076fd-82c3-44bf-8199-242308a6285b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:03.192840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-426076fd-82c3-44bf-8199-242308a6285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:03.261959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:03.294816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426076fd-82c3-44bf-8199-242308a6285b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:03.371076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbacb3-645f-4ea9-bfa1-dfbf39f0627a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:03.371711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbacb3-645f-4ea9-bfa1-dfbf39f0627a service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:03.372025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbacb3-645f-4ea9-bfa1-dfbf39f0627a service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:03.372293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbacb3-645f-4ea9-bfa1-dfbf39f0627a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:03.373927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-16dbacb3-645f-4ea9-bfa1-dfbf39f0627a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:03.483946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbacb3-645f-4ea9-bfa1-dfbf39f0627a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:03.485336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dbacb3-645f-4ea9-bfa1-dfbf39f0627a service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:03.495320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:03.503159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 668/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:05.773738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea3f86-e5e1-49d0-ac41-693bffb66308 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:05.774286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea3f86-e5e1-49d0-ac41-693bffb66308 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:05.774286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea3f86-e5e1-49d0-ac41-693bffb66308 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:05.775626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 667/1335] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:05.780862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caedf70-6ddb-40a5-93ef-ca55fed5126f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:05.781381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caedf70-6ddb-40a5-93ef-ca55fed5126f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:05.781490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caedf70-6ddb-40a5-93ef-ca55fed5126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:05.846607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5caedf70-6ddb-40a5-93ef-ca55fed5126f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:05.847794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5caedf70-6ddb-40a5-93ef-ca55fed5126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:05.944167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 669/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:05.983731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea3f86-e5e1-49d0-ac41-693bffb66308 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:05.985812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6aea3f86-e5e1-49d0-ac41-693bffb66308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:06.025145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:06.087092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea3f86-e5e1-49d0-ac41-693bffb66308 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:06.159702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1ea80-39fb-4c38-aaa6-939066daf1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:06.160336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ea80-39fb-4c38-aaa6-939066daf1af service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:06.160610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ea80-39fb-4c38-aaa6-939066daf1af service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:06.160874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1ea80-39fb-4c38-aaa6-939066daf1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:06.162505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d8c1ea80-39fb-4c38-aaa6-939066daf1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:06.243233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:06.269250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1ea80-39fb-4c38-aaa6-939066daf1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:06.270695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1ea80-39fb-4c38-aaa6-939066daf1af service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:06.288362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 668/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:09.203340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6626b0-aad0-4747-91af-60da681cbc1c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:09.203858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6626b0-aad0-4747-91af-60da681cbc1c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:09.203858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6626b0-aad0-4747-91af-60da681cbc1c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:09.205305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 670/1338] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:09.210764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c86e6-c6df-40e1-8e47-0298f56ad2e9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:09.211167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c86e6-c6df-40e1-8e47-0298f56ad2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:09.211323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c86e6-c6df-40e1-8e47-0298f56ad2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:09.276634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f78c86e6-c6df-40e1-8e47-0298f56ad2e9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:09.277836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f78c86e6-c6df-40e1-8e47-0298f56ad2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:09.373993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 669/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:09.410547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6626b0-aad0-4747-91af-60da681cbc1c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:09.412106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0a6626b0-aad0-4747-91af-60da681cbc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:09.488407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:09.518381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6626b0-aad0-4747-91af-60da681cbc1c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:09.595339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffd62-f5f4-4d95-a019-13410a16b206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:09.595983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd62-f5f4-4d95-a019-13410a16b206 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:09.596265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd62-f5f4-4d95-a019-13410a16b206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:09.596538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffd62-f5f4-4d95-a019-13410a16b206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:09.598636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d0cffd62-f5f4-4d95-a019-13410a16b206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:09.709930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cffd62-f5f4-4d95-a019-13410a16b206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:09.711387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cffd62-f5f4-4d95-a019-13410a16b206 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:09.729040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 671/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:14.202931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf0eb-12a1-484b-b84a-5dac8c42c7ea None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:14.203452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf0eb-12a1-484b-b84a-5dac8c42c7ea None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:14.203452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf0eb-12a1-484b-b84a-5dac8c42c7ea None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:14.205030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 670/1341] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:14.210622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633d77-24e4-4c26-b38f-20d76981c880 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:14.211043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633d77-24e4-4c26-b38f-20d76981c880 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:14.211168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45633d77-24e4-4c26-b38f-20d76981c880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:14.216150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:14.261996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-45633d77-24e4-4c26-b38f-20d76981c880 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:14.263129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-45633d77-24e4-4c26-b38f-20d76981c880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:14.341080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 672/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:14.380747 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf0eb-12a1-484b-b84a-5dac8c42c7ea None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:14.383004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-937cf0eb-12a1-484b-b84a-5dac8c42c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:14.431364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:14.463968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf0eb-12a1-484b-b84a-5dac8c42c7ea None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:14.467451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b2809-4129-4767-9e08-47e0ef5795b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:14.468094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b2809-4129-4767-9e08-47e0ef5795b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:14.468373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b2809-4129-4767-9e08-47e0ef5795b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:14.468649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b2809-4129-4767-9e08-47e0ef5795b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:14.477682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b2809-4129-4767-9e08-47e0ef5795b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:14.479131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b2809-4129-4767-9e08-47e0ef5795b6 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:14.488336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 671/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:17.516210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94516a-0bb9-42f4-9ade-e1f66ffecf25 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:17.516622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94516a-0bb9-42f4-9ade-e1f66ffecf25 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:17.516877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94516a-0bb9-42f4-9ade-e1f66ffecf25 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:17.518605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 673/1344] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:17.523494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9a52-a283-474d-9887-6d6d4478c95a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:17.523889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9a52-a283-474d-9887-6d6d4478c95a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:17.524071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df9a52-a283-474d-9887-6d6d4478c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:17.551980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-27df9a52-a283-474d-9887-6d6d4478c95a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:17.553140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-27df9a52-a283-474d-9887-6d6d4478c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:17.570191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 672/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:17.606852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94516a-0bb9-42f4-9ade-e1f66ffecf25 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:17.618064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94516a-0bb9-42f4-9ade-e1f66ffecf25 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:17.621596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00de1ae-4cca-45ff-a593-866f72f268e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:17.622260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de1ae-4cca-45ff-a593-866f72f268e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:17.622540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de1ae-4cca-45ff-a593-866f72f268e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:17.622811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00de1ae-4cca-45ff-a593-866f72f268e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:17.632006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00de1ae-4cca-45ff-a593-866f72f268e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:17.633433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00de1ae-4cca-45ff-a593-866f72f268e2 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:17.643544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 674/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:22.155713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cfa97-292c-4357-a2cf-13bbbf0bdac1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:22.156212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cfa97-292c-4357-a2cf-13bbbf0bdac1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:22.156316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cfa97-292c-4357-a2cf-13bbbf0bdac1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:22.157832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 673/1347] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:22.163203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b105d-833b-48fe-ae82-bf9c86aee5a9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:22.163720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b105d-833b-48fe-ae82-bf9c86aee5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:22.163720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b105d-833b-48fe-ae82-bf9c86aee5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:22.182083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-518b105d-833b-48fe-ae82-bf9c86aee5a9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:22.183204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-518b105d-833b-48fe-ae82-bf9c86aee5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:22.192060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 675/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:22.229394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cfa97-292c-4357-a2cf-13bbbf0bdac1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:22.231196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9d9cfa97-292c-4357-a2cf-13bbbf0bdac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:22.245160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cfa97-292c-4357-a2cf-13bbbf0bdac1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:22.248640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df61614-7e36-4a9a-8ccf-7a73db40af6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:22.249262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61614-7e36-4a9a-8ccf-7a73db40af6b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:22.249537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61614-7e36-4a9a-8ccf-7a73db40af6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:22.249805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61614-7e36-4a9a-8ccf-7a73db40af6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:22.259641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df61614-7e36-4a9a-8ccf-7a73db40af6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:22.261033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df61614-7e36-4a9a-8ccf-7a73db40af6b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:22.270427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 674/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:27.665634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728bdf4-814e-4d7a-ae87-02f92a1d41e7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:27.670757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728bdf4-814e-4d7a-ae87-02f92a1d41e7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:27.670757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728bdf4-814e-4d7a-ae87-02f92a1d41e7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:27.670757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 676/1350] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:27.676802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5c18-ea62-4d4a-b756-2efc0cbfa6f7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:27.677261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5c18-ea62-4d4a-b756-2efc0cbfa6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:27.677348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f5c18-ea62-4d4a-b756-2efc0cbfa6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:27.813171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-594f5c18-ea62-4d4a-b756-2efc0cbfa6f7 None None] MFA Rules not processed for user `e234faadf42946058f41bd8e7b43408a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:27.815075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-594f5c18-ea62-4d4a-b756-2efc0cbfa6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:27.946994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 675/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:33:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:32.107207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd629be-7d4b-4a0d-8630-b388513cc2f7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:32.107822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd629be-7d4b-4a0d-8630-b388513cc2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:32.107822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd629be-7d4b-4a0d-8630-b388513cc2f7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:32.109391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 677/1352] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:32.115360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cd90f-107e-453a-93fd-8b33c29eeadb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:32.115790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cd90f-107e-453a-93fd-8b33c29eeadb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:32.116095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cd90f-107e-453a-93fd-8b33c29eeadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:32.136078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-817cd90f-107e-453a-93fd-8b33c29eeadb None None] MFA Rules not processed for user `e234faadf42946058f41bd8e7b43408a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:32.137268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-817cd90f-107e-453a-93fd-8b33c29eeadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:32.146896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 676/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:33:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:32.176601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=52 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:33.827393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dea47-1155-42dc-b06c-5067004b77b5 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:33.828017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dea47-1155-42dc-b06c-5067004b77b5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:33.828017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dea47-1155-42dc-b06c-5067004b77b5 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:33.829332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 678/1354] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:33.834487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912670ca-a80e-4342-83ad-bd02079a71c1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:33.834933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912670ca-a80e-4342-83ad-bd02079a71c1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:33.835056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912670ca-a80e-4342-83ad-bd02079a71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:33.854256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-912670ca-a80e-4342-83ad-bd02079a71c1 None None] MFA Rules not processed for user `e234faadf42946058f41bd8e7b43408a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:33.855423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-912670ca-a80e-4342-83ad-bd02079a71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:33.864379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 677/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:33:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:37.721531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90c9c9-1375-4d4a-b6f4-6654eefb9169 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:37.722257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90c9c9-1375-4d4a-b6f4-6654eefb9169 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:37.722257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90c9c9-1375-4d4a-b6f4-6654eefb9169 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:37.723540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 679/1356] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:37.728495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092223d-a1b5-43b6-aaef-ada75272ebb8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:37.728889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092223d-a1b5-43b6-aaef-ada75272ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:37.729041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092223d-a1b5-43b6-aaef-ada75272ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:37.747685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2092223d-a1b5-43b6-aaef-ada75272ebb8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:37.748861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2092223d-a1b5-43b6-aaef-ada75272ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:37.756918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 678/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:37.813192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2f657-9fab-4aa5-b4a8-b8b3b2f2c69f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:37.815395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2f657-9fab-4aa5-b4a8-b8b3b2f2c69f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:37.816632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2f657-9fab-4aa5-b4a8-b8b3b2f2c69f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:37.822056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 680/1358] 10.222.0.70 () {54 vars in 961 bytes} [Wed May 18 22:33:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:37.831579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c539-9c1e-4659-bd30-c4035e9593cb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:37.832062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c539-9c1e-4659-bd30-c4035e9593cb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:37.832467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0c539-9c1e-4659-bd30-c4035e9593cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:37.866818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:37.895851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c9c0c539-9c1e-4659-bd30-c4035e9593cb None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:37.897135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c9c0c539-9c1e-4659-bd30-c4035e9593cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:37.983842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 679/1359] 10.222.0.70 () {58 vars in 1058 bytes} [Wed May 18 22:33:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:37.993007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2f657-9fab-4aa5-b4a8-b8b3b2f2c69f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:38.009319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2f657-9fab-4aa5-b4a8-b8b3b2f2c69f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:38.015672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6885baf-c7b2-413a-8cca-0a1244b8e9e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:38.016939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885baf-c7b2-413a-8cca-0a1244b8e9e3 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:38.017262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885baf-c7b2-413a-8cca-0a1244b8e9e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:38.018324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6885baf-c7b2-413a-8cca-0a1244b8e9e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:38.028169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6885baf-c7b2-413a-8cca-0a1244b8e9e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:38.030086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6885baf-c7b2-413a-8cca-0a1244b8e9e3 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:38.042028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 681/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:33:40.509228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ca62-e712-47c0-bbd2-bb0b5cb08414 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:40.509754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ca62-e712-47c0-bbd2-bb0b5cb08414 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:40.509754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ca62-e712-47c0-bbd2-bb0b5cb08414 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:40.511313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 680/1361] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:40.516369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468e76f-6163-419e-8ae0-4d2547da8d32 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:40.517332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468e76f-6163-419e-8ae0-4d2547da8d32 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:40.517455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468e76f-6163-419e-8ae0-4d2547da8d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:40.537152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6468e76f-6163-419e-8ae0-4d2547da8d32 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:40.538545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6468e76f-6163-419e-8ae0-4d2547da8d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:40.550055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 682/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:40.590818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ca62-e712-47c0-bbd2-bb0b5cb08414 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:40.606481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ca62-e712-47c0-bbd2-bb0b5cb08414 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:40.612027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11db99d-89e8-4589-b427-ba15245ee461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:40.612734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db99d-89e8-4589-b427-ba15245ee461 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:40.613185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db99d-89e8-4589-b427-ba15245ee461 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:40.613533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11db99d-89e8-4589-b427-ba15245ee461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:40.622064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11db99d-89e8-4589-b427-ba15245ee461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:40.623741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11db99d-89e8-4589-b427-ba15245ee461 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:40.634088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 681/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:43.377958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197fa9-47b6-4f9e-9473-1a563f402bb4 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:43.378507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197fa9-47b6-4f9e-9473-1a563f402bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:43.378604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197fa9-47b6-4f9e-9473-1a563f402bb4 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:43.380014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 683/1364] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:43.385414 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727225ec-1573-4f00-a5a8-5f3b888db9b1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:43.385821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727225ec-1573-4f00-a5a8-5f3b888db9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:43.386126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727225ec-1573-4f00-a5a8-5f3b888db9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:43.404973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-727225ec-1573-4f00-a5a8-5f3b888db9b1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:43.406276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-727225ec-1573-4f00-a5a8-5f3b888db9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:43.414242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 682/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:43.462639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a79e9-54ef-499a-a01e-ce75881bacd4 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:43.462925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a79e9-54ef-499a-a01e-ce75881bacd4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:43.463205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a79e9-54ef-499a-a01e-ce75881bacd4 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:43.464627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 684/1366] 10.222.0.70 () {54 vars in 961 bytes} [Wed May 18 22:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:43.476230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d46c-3de2-43e2-87e7-b01b7692b0f6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:43.476653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d46c-3de2-43e2-87e7-b01b7692b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:43.476932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d46c-3de2-43e2-87e7-b01b7692b0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:43.496334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9263d46c-3de2-43e2-87e7-b01b7692b0f6 None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:43.497564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9263d46c-3de2-43e2-87e7-b01b7692b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:43.511778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 683/1367] 10.222.0.70 () {58 vars in 1058 bytes} [Wed May 18 22:33:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:43.535093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a79e9-54ef-499a-a01e-ce75881bacd4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:43.557680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a79e9-54ef-499a-a01e-ce75881bacd4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:43.564082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad28b8-ee24-4a79-8801-5624c768ac76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:43.564766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad28b8-ee24-4a79-8801-5624c768ac76 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:43.565032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad28b8-ee24-4a79-8801-5624c768ac76 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:43.565411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad28b8-ee24-4a79-8801-5624c768ac76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:43.574426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad28b8-ee24-4a79-8801-5624c768ac76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:43.576081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad28b8-ee24-4a79-8801-5624c768ac76 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:43.585640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 685/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:46.053575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887fe6e-115a-4b49-a956-f203192746d3 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:46.054161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887fe6e-115a-4b49-a956-f203192746d3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:46.054248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887fe6e-115a-4b49-a956-f203192746d3 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:46.058358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 684/1369] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:46.062195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081fb9c-5cc9-4310-ba10-2fa6e9f722d4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:46.063005 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081fb9c-5cc9-4310-ba10-2fa6e9f722d4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:46.064036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081fb9c-5cc9-4310-ba10-2fa6e9f722d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:46.084905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2081fb9c-5cc9-4310-ba10-2fa6e9f722d4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:46.086506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2081fb9c-5cc9-4310-ba10-2fa6e9f722d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:46.102479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 686/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:46.142977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887fe6e-115a-4b49-a956-f203192746d3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:46.158729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887fe6e-115a-4b49-a956-f203192746d3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:46.164570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92fa1b-af96-4aa3-89bb-aaf62f91681a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:46.165423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92fa1b-af96-4aa3-89bb-aaf62f91681a service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:46.165860 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92fa1b-af96-4aa3-89bb-aaf62f91681a service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:46.166306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92fa1b-af96-4aa3-89bb-aaf62f91681a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:46.176221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92fa1b-af96-4aa3-89bb-aaf62f91681a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:46.178083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f92fa1b-af96-4aa3-89bb-aaf62f91681a service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:46.189098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 685/1371] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:46.257899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d5b2e-3da0-4a63-a735-37766dad0658 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:46.258230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d5b2e-3da0-4a63-a735-37766dad0658 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:46.258514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d5b2e-3da0-4a63-a735-37766dad0658 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:46.259898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 687/1372] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:46.265407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6181-3576-49b4-ad8c-2be5806d90c4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:46.265796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6181-3576-49b4-ad8c-2be5806d90c4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:46.266197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc6181-3576-49b4-ad8c-2be5806d90c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:46.287390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-95fc6181-3576-49b4-ad8c-2be5806d90c4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:46.287600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-95fc6181-3576-49b4-ad8c-2be5806d90c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:46.295765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 686/1373] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:33:46.618014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8511-2be0-4f00-a126-b5731907533b None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:46.618014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8511-2be0-4f00-a126-b5731907533b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:46.618014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af8511-2be0-4f00-a126-b5731907533b None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:46.620740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 688/1374] 10.222.0.70 () {54 vars in 963 bytes} [Wed May 18 22:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:46.624398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e120-fc02-4e79-81d6-b05942ff0ad7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:46.624801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e120-fc02-4e79-81d6-b05942ff0ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:46.625153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e120-fc02-4e79-81d6-b05942ff0ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:46.677917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3f69e120-fc02-4e79-81d6-b05942ff0ad7 None None] MFA Rules not processed for user `fe4941cd1afb4318b42263390025d198`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:46.679528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3f69e120-fc02-4e79-81d6-b05942ff0ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:46.741846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:46.747675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 687/1375] 10.222.0.70 () {58 vars in 1060 bytes} [Wed May 18 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:33:46.756697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8511-2be0-4f00-a126-b5731907533b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:46.768302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af8511-2be0-4f00-a126-b5731907533b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:46.771935 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be981c4-c902-4efd-a269-1a1b5ea8ef23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:46.772570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be981c4-c902-4efd-a269-1a1b5ea8ef23 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:46.773005 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be981c4-c902-4efd-a269-1a1b5ea8ef23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:46.773361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be981c4-c902-4efd-a269-1a1b5ea8ef23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:46.784059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be981c4-c902-4efd-a269-1a1b5ea8ef23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:46.785602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be981c4-c902-4efd-a269-1a1b5ea8ef23 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:46.795907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 689/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:48.589464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ad1d-2584-426f-98bb-cfb81d323a56 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:48.590105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ad1d-2584-426f-98bb-cfb81d323a56 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:48.590105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ad1d-2584-426f-98bb-cfb81d323a56 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:48.591424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 688/1377] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:48.597795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bdd5-e339-425d-85fc-2aed81ccd9c7 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:48.598400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bdd5-e339-425d-85fc-2aed81ccd9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:48.598400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7bdd5-e339-425d-85fc-2aed81ccd9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:48.617664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-50e7bdd5-e339-425d-85fc-2aed81ccd9c7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:48.618912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-50e7bdd5-e339-425d-85fc-2aed81ccd9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:48.627420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 690/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:48.672916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619ad1d-2584-426f-98bb-cfb81d323a56 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:48.688430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619ad1d-2584-426f-98bb-cfb81d323a56 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:48.693853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0d5c1-90c6-4267-a90e-850a560a0cc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:48.694538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d5c1-90c6-4267-a90e-850a560a0cc2 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:48.694813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d5c1-90c6-4267-a90e-850a560a0cc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:48.695084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d5c1-90c6-4267-a90e-850a560a0cc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:48.705254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0d5c1-90c6-4267-a90e-850a560a0cc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:48.706925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0d5c1-90c6-4267-a90e-850a560a0cc2 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:48.718035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 689/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:51.087052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73ebb-b49e-4f8c-bec6-b9c5bd183518 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:51.087628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73ebb-b49e-4f8c-bec6-b9c5bd183518 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:51.087628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc73ebb-b49e-4f8c-bec6-b9c5bd183518 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:51.088937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 691/1380] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:51.094200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76c30-22b0-4394-9747-a19303df81fc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:51.095286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76c30-22b0-4394-9747-a19303df81fc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:51.095566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b76c30-22b0-4394-9747-a19303df81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:51.113874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b6b76c30-22b0-4394-9747-a19303df81fc None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:51.115077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b6b76c30-22b0-4394-9747-a19303df81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:51.122983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 690/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:51.167101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73ebb-b49e-4f8c-bec6-b9c5bd183518 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:51.182500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc73ebb-b49e-4f8c-bec6-b9c5bd183518 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:51.188573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771038c3-9514-4e50-b976-cdccac0b1105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:51.189353 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771038c3-9514-4e50-b976-cdccac0b1105 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:51.189656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771038c3-9514-4e50-b976-cdccac0b1105 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:51.189932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771038c3-9514-4e50-b976-cdccac0b1105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:51.198957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771038c3-9514-4e50-b976-cdccac0b1105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:51.200730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771038c3-9514-4e50-b976-cdccac0b1105 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:51.211253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 692/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:53.583942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8cd3c-442b-42a3-926f-d8250e260abb None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:53.584507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8cd3c-442b-42a3-926f-d8250e260abb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:53.584609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8cd3c-442b-42a3-926f-d8250e260abb None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:53.586877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 691/1383] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:53.591930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef72192-4b80-4a7b-b6c1-4345296e1241 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:53.592390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef72192-4b80-4a7b-b6c1-4345296e1241 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:53.592495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef72192-4b80-4a7b-b6c1-4345296e1241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:53.612162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5ef72192-4b80-4a7b-b6c1-4345296e1241 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:53.613334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5ef72192-4b80-4a7b-b6c1-4345296e1241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:53.621715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 693/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:53.665614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8cd3c-442b-42a3-926f-d8250e260abb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:53.681892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8cd3c-442b-42a3-926f-d8250e260abb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:53.688294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edb304-b80c-491c-8a44-250713d6649b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:53.689171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edb304-b80c-491c-8a44-250713d6649b service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:53.689518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edb304-b80c-491c-8a44-250713d6649b service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:53.689857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edb304-b80c-491c-8a44-250713d6649b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:53.700134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edb304-b80c-491c-8a44-250713d6649b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:53.702287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edb304-b80c-491c-8a44-250713d6649b service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:53.714341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 692/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:33:55.952500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae23c9-0fa6-41fb-9dda-4536b95f096f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:55.953047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae23c9-0fa6-41fb-9dda-4536b95f096f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:55.953146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae23c9-0fa6-41fb-9dda-4536b95f096f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:55.955790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 694/1386] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:55.962302 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb577-a72b-44b7-8326-79ec3d55033b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:55.962864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb577-a72b-44b7-8326-79ec3d55033b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:55.962864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeb577-a72b-44b7-8326-79ec3d55033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:55.980883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bdbeb577-a72b-44b7-8326-79ec3d55033b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:55.982141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bdbeb577-a72b-44b7-8326-79ec3d55033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:55.991544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 693/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:56.036100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae23c9-0fa6-41fb-9dda-4536b95f096f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:56.057254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae23c9-0fa6-41fb-9dda-4536b95f096f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:56.064936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27929b1e-ee5e-41d9-b7de-5944d691bb4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:56.065740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27929b1e-ee5e-41d9-b7de-5944d691bb4a service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:56.066128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27929b1e-ee5e-41d9-b7de-5944d691bb4a service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:56.066489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27929b1e-ee5e-41d9-b7de-5944d691bb4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:56.076972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27929b1e-ee5e-41d9-b7de-5944d691bb4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:56.080009 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27929b1e-ee5e-41d9-b7de-5944d691bb4a service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:56.092007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 695/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:33:59.028795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1d6f-7258-4fae-8d60-a6e107804cee None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:59.029343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1d6f-7258-4fae-8d60-a6e107804cee None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:59.029456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1d6f-7258-4fae-8d60-a6e107804cee None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:59.030780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 694/1389] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:33:59.037329 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1cced-8c1b-4395-a960-3fab1356f377 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:59.037794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1cced-8c1b-4395-a960-3fab1356f377 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:59.038057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1cced-8c1b-4395-a960-3fab1356f377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:59.056776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6be1cced-8c1b-4395-a960-3fab1356f377 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:33:59.058139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6be1cced-8c1b-4395-a960-3fab1356f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:33:59.067152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 696/1390] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:33:59.111869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f1d6f-7258-4fae-8d60-a6e107804cee None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:33:59.126558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f1d6f-7258-4fae-8d60-a6e107804cee None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:33:59.131890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf0de1-9467-496e-b858-bdcfc17ab26a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:33:59.132520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf0de1-9467-496e-b858-bdcfc17ab26a service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:33:59.132798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf0de1-9467-496e-b858-bdcfc17ab26a service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:33:59.133071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf0de1-9467-496e-b858-bdcfc17ab26a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:33:59.142945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf0de1-9467-496e-b858-bdcfc17ab26a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:33:59.145022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf0de1-9467-496e-b858-bdcfc17ab26a service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:33:59.158653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 695/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:01.772388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5903a-1346-49d7-b619-1c8ca7ba6389 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:01.772987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5903a-1346-49d7-b619-1c8ca7ba6389 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:01.772987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5903a-1346-49d7-b619-1c8ca7ba6389 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:01.774479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 697/1392] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:01.779495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78291f0-6f0f-422e-946c-10e5028786ba None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:01.779931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78291f0-6f0f-422e-946c-10e5028786ba None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:01.780028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78291f0-6f0f-422e-946c-10e5028786ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:01.798603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a78291f0-6f0f-422e-946c-10e5028786ba None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:01.799785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a78291f0-6f0f-422e-946c-10e5028786ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:01.807563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 696/1393] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:01.851476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5903a-1346-49d7-b619-1c8ca7ba6389 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:01.866485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5903a-1346-49d7-b619-1c8ca7ba6389 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:01.871900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b3c1b-35d9-4538-a493-04e30ea2b642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:01.872521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b3c1b-35d9-4538-a493-04e30ea2b642 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:01.872797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b3c1b-35d9-4538-a493-04e30ea2b642 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:01.873067 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b3c1b-35d9-4538-a493-04e30ea2b642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:01.881593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b3c1b-35d9-4538-a493-04e30ea2b642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:01.883198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b3c1b-35d9-4538-a493-04e30ea2b642 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:01.893375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 698/1394] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:02.933555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf98ec-732c-49b4-8d3a-9a77578499db None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:02.934213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf98ec-732c-49b4-8d3a-9a77578499db None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:02.934213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf98ec-732c-49b4-8d3a-9a77578499db None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:02.935756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 697/1395] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:02.940925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62e70-9045-4dc9-9a40-6bc14a7e8882 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:02.941379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62e70-9045-4dc9-9a40-6bc14a7e8882 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:02.941488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62e70-9045-4dc9-9a40-6bc14a7e8882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:02.947675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=52 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:34:02.960088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-19b62e70-9045-4dc9-9a40-6bc14a7e8882 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:02.961270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-19b62e70-9045-4dc9-9a40-6bc14a7e8882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:02.969378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 699/1396] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:03.026507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb8dc-6235-46a1-9fc6-7143b2f7d812 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:03.026819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb8dc-6235-46a1-9fc6-7143b2f7d812 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:03.027084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fb8dc-6235-46a1-9fc6-7143b2f7d812 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:03.028436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 698/1397] 10.222.0.70 () {54 vars in 962 bytes} [Wed May 18 22:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:03.033960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d757-0f51-40ec-bfde-9a74859559fb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:03.034274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d757-0f51-40ec-bfde-9a74859559fb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:03.034566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d757-0f51-40ec-bfde-9a74859559fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:03.086105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5fe0d757-0f51-40ec-bfde-9a74859559fb None None] MFA Rules not processed for user `cc7d46c2766b4481963adefebea94c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:03.087281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5fe0d757-0f51-40ec-bfde-9a74859559fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:03.145967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 700/1398] 10.222.0.70 () {58 vars in 1059 bytes} [Wed May 18 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:03.153269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fb8dc-6235-46a1-9fc6-7143b2f7d812 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:03.164197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fb8dc-6235-46a1-9fc6-7143b2f7d812 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:03.167628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa034eac-6efa-4df0-9b76-33408039cb6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7d46c2766b4481963adefebea94c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:03.168247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034eac-6efa-4df0-9b76-33408039cb6f service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:03.168523 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034eac-6efa-4df0-9b76-33408039cb6f service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:03.168792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa034eac-6efa-4df0-9b76-33408039cb6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:03.178365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa034eac-6efa-4df0-9b76-33408039cb6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:03.179783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa034eac-6efa-4df0-9b76-33408039cb6f service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:03.191235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 699/1399] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:03.797975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c420-6636-4ebe-ba03-982703a331ef None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:03.798302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c420-6636-4ebe-ba03-982703a331ef None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:03.798585 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6c420-6636-4ebe-ba03-982703a331ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:03.848831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-02a6c420-6636-4ebe-ba03-982703a331ef None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:03.850031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-02a6c420-6636-4ebe-ba03-982703a331ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:03.912875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 701/1400] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:03.959191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2accb8-5936-4a4e-bb6b-6c1142b046e8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:03.959681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2accb8-5936-4a4e-bb6b-6c1142b046e8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:03.959878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2accb8-5936-4a4e-bb6b-6c1142b046e8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:03.961321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 700/1401] 10.222.0.70 () {54 vars in 942 bytes} [Wed May 18 22:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:03.967683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4b116-54f8-435c-9813-1e71fd601990 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:03.968128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4b116-54f8-435c-9813-1e71fd601990 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:03.968236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4b116-54f8-435c-9813-1e71fd601990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:04.018767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1ba4b116-54f8-435c-9813-1e71fd601990 None None] MFA Rules not processed for user `c90d79a9665b4d9f8dc1ea440882a65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:04.019946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1ba4b116-54f8-435c-9813-1e71fd601990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:04.032884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:34:04.091873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 702/1402] 10.222.0.70 () {58 vars in 1039 bytes} [Wed May 18 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:04.101861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2accb8-5936-4a4e-bb6b-6c1142b046e8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:04.116365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2accb8-5936-4a4e-bb6b-6c1142b046e8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:04.121458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2fe2d-17e9-4927-bc17-916076007605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:04.122159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2fe2d-17e9-4927-bc17-916076007605 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:04.122440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2fe2d-17e9-4927-bc17-916076007605 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:04.122710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2fe2d-17e9-4927-bc17-916076007605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:04.132147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2fe2d-17e9-4927-bc17-916076007605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:04.133744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2fe2d-17e9-4927-bc17-916076007605 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:04.143316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 701/1403] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:34:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:34:04.301477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc8c6b-f1f6-4ca4-b181-5208684ecf14 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:04.301820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc8c6b-f1f6-4ca4-b181-5208684ecf14 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:04.302122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc8c6b-f1f6-4ca4-b181-5208684ecf14 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:04.303516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 703/1404] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:04.308652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3ace-7c94-457e-8545-a162f398ce0c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:04.308942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3ace-7c94-457e-8545-a162f398ce0c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:04.309506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3ace-7c94-457e-8545-a162f398ce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:04.328143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-807b3ace-7c94-457e-8545-a162f398ce0c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:04.329490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-807b3ace-7c94-457e-8545-a162f398ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:04.337271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 702/1405] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:04.381914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc8c6b-f1f6-4ca4-b181-5208684ecf14 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:04.396028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc8c6b-f1f6-4ca4-b181-5208684ecf14 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:04.401269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc13ffa-ede8-4e45-ae1b-0671524faf5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:04.401889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13ffa-ede8-4e45-ae1b-0671524faf5c service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:04.402213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13ffa-ede8-4e45-ae1b-0671524faf5c service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:04.402484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc13ffa-ede8-4e45-ae1b-0671524faf5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:04.410478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc13ffa-ede8-4e45-ae1b-0671524faf5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:04.412034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc13ffa-ede8-4e45-ae1b-0671524faf5c service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:04.425428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 704/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:06.902827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8d3d-b358-46d0-9600-58135cf78431 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:06.903419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8d3d-b358-46d0-9600-58135cf78431 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:06.903623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd8d3d-b358-46d0-9600-58135cf78431 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:06.905069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 703/1407] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:34:06.911251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285871-ec21-4ea6-a130-cd127362c6f1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:06.911690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285871-ec21-4ea6-a130-cd127362c6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:06.911790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e285871-ec21-4ea6-a130-cd127362c6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:06.933923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4e285871-ec21-4ea6-a130-cd127362c6f1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:06.935507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4e285871-ec21-4ea6-a130-cd127362c6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:06.944183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 705/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:06.991030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd8d3d-b358-46d0-9600-58135cf78431 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:07.006131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd8d3d-b358-46d0-9600-58135cf78431 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:07.011676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a228e-1610-4d83-9914-f67a4ed32496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:07.012403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a228e-1610-4d83-9914-f67a4ed32496 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:07.012739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a228e-1610-4d83-9914-f67a4ed32496 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:07.013075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a228e-1610-4d83-9914-f67a4ed32496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:07.024759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a228e-1610-4d83-9914-f67a4ed32496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:07.026613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a228e-1610-4d83-9914-f67a4ed32496 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:07.038483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 704/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:16.928110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=33 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:34:17.032998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=49 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:34:29.722414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3a94-7ffe-4b92-b39f-5f47d31be5df None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:29.723025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3a94-7ffe-4b92-b39f-5f47d31be5df None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:29.723025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3a94-7ffe-4b92-b39f-5f47d31be5df None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:29.724233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 706/1410] 10.222.0.70 () {54 vars in 918 bytes} [Wed May 18 22:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:29.729381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0ce54-abed-49cd-9d7c-4345fe36ec88 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:29.729879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0ce54-abed-49cd-9d7c-4345fe36ec88 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:29.729988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0ce54-abed-49cd-9d7c-4345fe36ec88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:29.747620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c2c0ce54-abed-49cd-9d7c-4345fe36ec88 None None] MFA Rules not processed for user `e234faadf42946058f41bd8e7b43408a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:29.748838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c2c0ce54-abed-49cd-9d7c-4345fe36ec88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:29.757813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 705/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Wed May 18 22:34:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:29.772449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f0fe-8096-4723-93fa-d485d9ebc2f7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:29.772730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f0fe-8096-4723-93fa-d485d9ebc2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:29.773003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650f0fe-8096-4723-93fa-d485d9ebc2f7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:29.774355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 707/1412] 10.222.0.70 () {54 vars in 918 bytes} [Wed May 18 22:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:29.778803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308e74-89ea-42e5-bafc-097fd9045abd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:29.779092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308e74-89ea-42e5-bafc-097fd9045abd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:29.779373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6308e74-89ea-42e5-bafc-097fd9045abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:29.797233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e6308e74-89ea-42e5-bafc-097fd9045abd None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:29.798497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e6308e74-89ea-42e5-bafc-097fd9045abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:29.807660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 706/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Wed May 18 22:34:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:32.523662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e69b0-3ff2-4369-9c49-16b07dcf5545 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:32.524289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e69b0-3ff2-4369-9c49-16b07dcf5545 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:32.524289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e69b0-3ff2-4369-9c49-16b07dcf5545 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:32.525554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:34:32.530768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5fed9-cb63-41e8-8729-6e6def82edd6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:32.531210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5fed9-cb63-41e8-8729-6e6def82edd6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:32.531318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5fed9-cb63-41e8-8729-6e6def82edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:32.549912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-39a5fed9-cb63-41e8-8729-6e6def82edd6 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:32.551117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-39a5fed9-cb63-41e8-8729-6e6def82edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:32.558752 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:32.601964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e69b0-3ff2-4369-9c49-16b07dcf5545 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:32.616827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e69b0-3ff2-4369-9c49-16b07dcf5545 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:32.622220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bd377-b18c-4cb1-b9f3-f9946265d3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:32.622850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bd377-b18c-4cb1-b9f3-f9946265d3a6 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:32.623135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bd377-b18c-4cb1-b9f3-f9946265d3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:32.623409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bd377-b18c-4cb1-b9f3-f9946265d3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:32.632451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bd377-b18c-4cb1-b9f3-f9946265d3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:32.634121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bd377-b18c-4cb1-b9f3-f9946265d3a6 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:32.644199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 709/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:33.631492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce021c-c4f5-4508-8739-02e2aa09b8e6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:33.632043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce021c-c4f5-4508-8739-02e2aa09b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:33.632043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce021c-c4f5-4508-8739-02e2aa09b8e6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:33.633480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:33.638251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559745-0884-4eef-a4c6-8d7e230578ee None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:33.638700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559745-0884-4eef-a4c6-8d7e230578ee None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:33.638809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10559745-0884-4eef-a4c6-8d7e230578ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:33.657135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-10559745-0884-4eef-a4c6-8d7e230578ee None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:33.658364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-10559745-0884-4eef-a4c6-8d7e230578ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:33.666106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:33.829004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce021c-c4f5-4508-8739-02e2aa09b8e6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:33.843073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce021c-c4f5-4508-8739-02e2aa09b8e6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:33.848543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82bcdf3-fbd9-4a11-8cc9-04e4b47e99eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:33.849170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bcdf3-fbd9-4a11-8cc9-04e4b47e99eb service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:33.849451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bcdf3-fbd9-4a11-8cc9-04e4b47e99eb service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:33.849724 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82bcdf3-fbd9-4a11-8cc9-04e4b47e99eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:33.857714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bcdf3-fbd9-4a11-8cc9-04e4b47e99eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:33.859307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82bcdf3-fbd9-4a11-8cc9-04e4b47e99eb service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:33.869501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 709/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:34.813381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c484faf-6877-436e-bd7b-f994752731ae None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:34.813973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c484faf-6877-436e-bd7b-f994752731ae None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:34.813973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c484faf-6877-436e-bd7b-f994752731ae None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:34.815369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:34.820257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b149-b067-429c-b3e8-480035ba339d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:34.820708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b149-b067-429c-b3e8-480035ba339d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:34.820802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b149-b067-429c-b3e8-480035ba339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:34.840251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7054b149-b067-429c-b3e8-480035ba339d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:34.841438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7054b149-b067-429c-b3e8-480035ba339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:34.850289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:35.002769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c484faf-6877-436e-bd7b-f994752731ae None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:35.016763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c484faf-6877-436e-bd7b-f994752731ae None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:35.023003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5353b-3cf1-4431-92c9-4dc62ce97f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:35.023628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5353b-3cf1-4431-92c9-4dc62ce97f9b service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:35.023907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5353b-3cf1-4431-92c9-4dc62ce97f9b service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:35.024787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5353b-3cf1-4431-92c9-4dc62ce97f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:35.033102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5353b-3cf1-4431-92c9-4dc62ce97f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:35.034710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5353b-3cf1-4431-92c9-4dc62ce97f9b service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:35.044362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 712/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:35.975362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299995f-4732-489c-8808-ff7b3afe9344 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:35.975928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299995f-4732-489c-8808-ff7b3afe9344 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:35.975928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299995f-4732-489c-8808-ff7b3afe9344 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:35.977268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:35.982167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08967e-d96f-4242-be8b-f6b8321232b1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:35.982564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08967e-d96f-4242-be8b-f6b8321232b1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:35.982718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08967e-d96f-4242-be8b-f6b8321232b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:36.002246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3e08967e-d96f-4242-be8b-f6b8321232b1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:36.003439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3e08967e-d96f-4242-be8b-f6b8321232b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:36.011144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:36.164690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299995f-4732-489c-8808-ff7b3afe9344 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:36.179633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299995f-4732-489c-8808-ff7b3afe9344 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:36.185232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280aee9-75ef-4291-b402-3b9987cc0dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:36.185857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280aee9-75ef-4291-b402-3b9987cc0dba service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:36.186176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280aee9-75ef-4291-b402-3b9987cc0dba service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:36.186454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280aee9-75ef-4291-b402-3b9987cc0dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:36.195482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280aee9-75ef-4291-b402-3b9987cc0dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:36.197037 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280aee9-75ef-4291-b402-3b9987cc0dba service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:36.206767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 712/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:37.134616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602fac1-eb94-4dde-95a9-791bef2c1029 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:37.135167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602fac1-eb94-4dde-95a9-791bef2c1029 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:37.135167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602fac1-eb94-4dde-95a9-791bef2c1029 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:37.136512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:37.141253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002502-7d84-42b0-b470-08ac8158e890 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:37.141696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002502-7d84-42b0-b470-08ac8158e890 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:37.141839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002502-7d84-42b0-b470-08ac8158e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:37.160017 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ec002502-7d84-42b0-b470-08ac8158e890 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:37.161184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ec002502-7d84-42b0-b470-08ac8158e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:37.168767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:37.318755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602fac1-eb94-4dde-95a9-791bef2c1029 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:37.332965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602fac1-eb94-4dde-95a9-791bef2c1029 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:37.338572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdd40f-77da-4cb7-b516-d7d664e87ac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:37.339205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd40f-77da-4cb7-b516-d7d664e87ac3 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:37.339479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd40f-77da-4cb7-b516-d7d664e87ac3 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:37.339749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdd40f-77da-4cb7-b516-d7d664e87ac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:37.348323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdd40f-77da-4cb7-b516-d7d664e87ac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:37.349961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdd40f-77da-4cb7-b516-d7d664e87ac3 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:37.359406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 715/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:38.345927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f05b-a3de-4a7f-b4ee-361e3b27dde7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:38.346496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f05b-a3de-4a7f-b4ee-361e3b27dde7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:38.346496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f05b-a3de-4a7f-b4ee-361e3b27dde7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:38.347969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:38.352892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f3350-134d-4ea1-bac2-c9b80197782d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:38.353302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f3350-134d-4ea1-bac2-c9b80197782d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:38.353468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f3350-134d-4ea1-bac2-c9b80197782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:38.373604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5d8f3350-134d-4ea1-bac2-c9b80197782d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:38.373604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5d8f3350-134d-4ea1-bac2-c9b80197782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:38.381420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:38.528599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3f05b-a3de-4a7f-b4ee-361e3b27dde7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:38.542915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3f05b-a3de-4a7f-b4ee-361e3b27dde7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:38.548924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0904-1b8a-4332-86e3-daaa22d7e9b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:38.549615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0904-1b8a-4332-86e3-daaa22d7e9b0 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:38.549897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0904-1b8a-4332-86e3-daaa22d7e9b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:38.550200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0904-1b8a-4332-86e3-daaa22d7e9b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:38.558376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee0904-1b8a-4332-86e3-daaa22d7e9b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:38.560230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee0904-1b8a-4332-86e3-daaa22d7e9b0 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:38.570551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 715/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:39.513083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7aa4-7bfd-4294-885e-5a7433d128e7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:39.513653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7aa4-7bfd-4294-885e-5a7433d128e7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:39.513653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7aa4-7bfd-4294-885e-5a7433d128e7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:39.515050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:39.520712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ec91-6601-46f0-aea0-a67b33594643 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:39.521135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ec91-6601-46f0-aea0-a67b33594643 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:39.521266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ec91-6601-46f0-aea0-a67b33594643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:39.539205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-71e1ec91-6601-46f0-aea0-a67b33594643 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:39.540389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-71e1ec91-6601-46f0-aea0-a67b33594643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:39.548075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:39.699458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7aa4-7bfd-4294-885e-5a7433d128e7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:39.714219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7aa4-7bfd-4294-885e-5a7433d128e7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:39.719517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4f7cc-7d70-4628-afc9-9f4c2ac7105e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:39.720891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f7cc-7d70-4628-afc9-9f4c2ac7105e service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:39.721170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f7cc-7d70-4628-afc9-9f4c2ac7105e service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:39.721442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4f7cc-7d70-4628-afc9-9f4c2ac7105e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:39.729430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4f7cc-7d70-4628-afc9-9f4c2ac7105e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:39.731029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4f7cc-7d70-4628-afc9-9f4c2ac7105e service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:39.740245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 718/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:40.674296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a721-766f-46c1-af35-01e2a89461aa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:40.674864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a721-766f-46c1-af35-01e2a89461aa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:40.674864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538a721-766f-46c1-af35-01e2a89461aa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:40.676241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:40.680955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55bf49-e80f-4856-99b8-b13194f3566e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:40.681399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55bf49-e80f-4856-99b8-b13194f3566e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:40.681499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55bf49-e80f-4856-99b8-b13194f3566e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:40.699647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6b55bf49-e80f-4856-99b8-b13194f3566e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:40.700808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6b55bf49-e80f-4856-99b8-b13194f3566e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:40.709304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:40.857728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538a721-766f-46c1-af35-01e2a89461aa None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:40.871744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538a721-766f-46c1-af35-01e2a89461aa None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:40.877588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a62354-90a0-4a9a-b873-30551d378407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:40.878252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62354-90a0-4a9a-b873-30551d378407 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:40.878532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62354-90a0-4a9a-b873-30551d378407 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:40.878806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62354-90a0-4a9a-b873-30551d378407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:40.888230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a62354-90a0-4a9a-b873-30551d378407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:40.889783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a62354-90a0-4a9a-b873-30551d378407 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:40.899766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 718/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:41.894840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e56d-7592-487d-b69a-0a4a1a9f60e9 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:41.895397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e56d-7592-487d-b69a-0a4a1a9f60e9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:41.895397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e56d-7592-487d-b69a-0a4a1a9f60e9 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:41.896747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:41.901593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499137-7e95-436b-a294-fee865890b6f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:41.902130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499137-7e95-436b-a294-fee865890b6f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:41.902231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499137-7e95-436b-a294-fee865890b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:41.921139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f2499137-7e95-436b-a294-fee865890b6f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:41.922479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f2499137-7e95-436b-a294-fee865890b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:41.930766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:42.082236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1e56d-7592-487d-b69a-0a4a1a9f60e9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:42.097114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1e56d-7592-487d-b69a-0a4a1a9f60e9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:42.107069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85cb8-5898-4354-a54a-39273b355dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:42.107069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85cb8-5898-4354-a54a-39273b355dc2 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:42.107069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85cb8-5898-4354-a54a-39273b355dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:42.107069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85cb8-5898-4354-a54a-39273b355dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:42.113378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85cb8-5898-4354-a54a-39273b355dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:42.114996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f85cb8-5898-4354-a54a-39273b355dc2 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:42.124290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 721/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:44.226553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e55b9-dd9f-4306-80b6-a22e166263db None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:44.227114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e55b9-dd9f-4306-80b6-a22e166263db None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:44.227114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e55b9-dd9f-4306-80b6-a22e166263db None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:44.228440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:44.233680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b451d14-168d-472c-9559-f19e54f4da5a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:44.234152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b451d14-168d-472c-9559-f19e54f4da5a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:44.234262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b451d14-168d-472c-9559-f19e54f4da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:44.251769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7b451d14-168d-472c-9559-f19e54f4da5a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:44.252946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7b451d14-168d-472c-9559-f19e54f4da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:44.260555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:34:44.298756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e55b9-dd9f-4306-80b6-a22e166263db None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:44.309441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e55b9-dd9f-4306-80b6-a22e166263db None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:44.312891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b001adc-ad39-4b01-b99d-354ec17984ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:44.313486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001adc-ad39-4b01-b99d-354ec17984ef service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:44.313779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001adc-ad39-4b01-b99d-354ec17984ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:44.314072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b001adc-ad39-4b01-b99d-354ec17984ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:44.322621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b001adc-ad39-4b01-b99d-354ec17984ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:44.324033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b001adc-ad39-4b01-b99d-354ec17984ef service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:44.333626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 721/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:46.695214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c176-dab5-4baf-a80d-85e3aa25cddd None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:46.695819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c176-dab5-4baf-a80d-85e3aa25cddd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:46.695819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52c176-dab5-4baf-a80d-85e3aa25cddd None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:46.697110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:46.702272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2b0b-adde-49f8-93af-0bfaef2fb13a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:46.702666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2b0b-adde-49f8-93af-0bfaef2fb13a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:46.702826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2b0b-adde-49f8-93af-0bfaef2fb13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:46.721786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-67ee2b0b-adde-49f8-93af-0bfaef2fb13a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:46.723020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-67ee2b0b-adde-49f8-93af-0bfaef2fb13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:46.730656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:46.769086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52c176-dab5-4baf-a80d-85e3aa25cddd None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:46.779474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52c176-dab5-4baf-a80d-85e3aa25cddd None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:46.783615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed3257-30b9-4c58-8ce7-bc037a1198ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:46.784242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3257-30b9-4c58-8ce7-bc037a1198ad service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:46.784518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3257-30b9-4c58-8ce7-bc037a1198ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:46.784787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3257-30b9-4c58-8ce7-bc037a1198ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:46.793458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed3257-30b9-4c58-8ce7-bc037a1198ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:46.794907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed3257-30b9-4c58-8ce7-bc037a1198ad service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:46.804130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 724/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:49.383764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9cdfd-06f2-4529-9c61-e07c54638a07 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:49.384892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9cdfd-06f2-4529-9c61-e07c54638a07 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:49.384892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9cdfd-06f2-4529-9c61-e07c54638a07 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:49.385699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:49.391351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8517c-d36a-4f4c-8d76-d6f933a9e43c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:49.392465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8517c-d36a-4f4c-8d76-d6f933a9e43c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:49.392662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8517c-d36a-4f4c-8d76-d6f933a9e43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:49.411358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-85d8517c-d36a-4f4c-8d76-d6f933a9e43c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:49.412564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-85d8517c-d36a-4f4c-8d76-d6f933a9e43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:49.420840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:49.460549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9cdfd-06f2-4529-9c61-e07c54638a07 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:49.471628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9cdfd-06f2-4529-9c61-e07c54638a07 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:49.475155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aff34-ee89-4816-97f0-3a0234e8587b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:49.477372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aff34-ee89-4816-97f0-3a0234e8587b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:49.477372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aff34-ee89-4816-97f0-3a0234e8587b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:49.477372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aff34-ee89-4816-97f0-3a0234e8587b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:49.485749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aff34-ee89-4816-97f0-3a0234e8587b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:49.487443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985aff34-ee89-4816-97f0-3a0234e8587b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:49.496721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 724/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:51.803077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db27c02-f7cf-4b68-9243-7c7885d6fbfb None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:51.803676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db27c02-f7cf-4b68-9243-7c7885d6fbfb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:51.803676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db27c02-f7cf-4b68-9243-7c7885d6fbfb None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:51.804972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:51.810537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0655d5-2ae2-4a2a-9b95-e227aae1797d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:51.810984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0655d5-2ae2-4a2a-9b95-e227aae1797d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:51.811090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0655d5-2ae2-4a2a-9b95-e227aae1797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:51.828415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3d0655d5-2ae2-4a2a-9b95-e227aae1797d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:51.830273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3d0655d5-2ae2-4a2a-9b95-e227aae1797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:51.837941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:51.875235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db27c02-f7cf-4b68-9243-7c7885d6fbfb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:51.885922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db27c02-f7cf-4b68-9243-7c7885d6fbfb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:51.889333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f902b-bdce-4ba5-afec-97f053e05885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:51.889995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f902b-bdce-4ba5-afec-97f053e05885 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:51.890298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f902b-bdce-4ba5-afec-97f053e05885 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:51.890570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f902b-bdce-4ba5-afec-97f053e05885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:51.900166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f902b-bdce-4ba5-afec-97f053e05885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:51.901694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f902b-bdce-4ba5-afec-97f053e05885 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:51.911492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 727/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:54.212296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238db93-d161-4c62-a394-63a9ca7876e7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:54.212868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238db93-d161-4c62-a394-63a9ca7876e7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:54.212868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238db93-d161-4c62-a394-63a9ca7876e7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:54.214281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:54.219581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a483-e9b0-4d58-b7ca-4dcaa22d1983 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:54.220024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a483-e9b0-4d58-b7ca-4dcaa22d1983 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:54.220140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3a483-e9b0-4d58-b7ca-4dcaa22d1983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:54.237905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-79c3a483-e9b0-4d58-b7ca-4dcaa22d1983 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:54.239098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-79c3a483-e9b0-4d58-b7ca-4dcaa22d1983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:54.246634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:54.284112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238db93-d161-4c62-a394-63a9ca7876e7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:54.294669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238db93-d161-4c62-a394-63a9ca7876e7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:54.299215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f54db-2d28-4f46-a57d-f759e1ae844f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:54.299836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f54db-2d28-4f46-a57d-f759e1ae844f service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:54.300118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f54db-2d28-4f46-a57d-f759e1ae844f service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:54.300393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f54db-2d28-4f46-a57d-f759e1ae844f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:54.309456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f54db-2d28-4f46-a57d-f759e1ae844f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:54.310936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f54db-2d28-4f46-a57d-f759e1ae844f service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:54.321221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 727/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:56.590130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082dfc0-a9a4-4dbc-ba8f-753131919eeb None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:56.590704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082dfc0-a9a4-4dbc-ba8f-753131919eeb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:56.590704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082dfc0-a9a4-4dbc-ba8f-753131919eeb None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:56.592058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:56.597977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b556416-d7a3-4cb3-9dd7-56c1d93f403e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:56.598477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b556416-d7a3-4cb3-9dd7-56c1d93f403e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:56.598579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b556416-d7a3-4cb3-9dd7-56c1d93f403e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:56.616949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0b556416-d7a3-4cb3-9dd7-56c1d93f403e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:56.618179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0b556416-d7a3-4cb3-9dd7-56c1d93f403e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:56.625763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:56.662982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082dfc0-a9a4-4dbc-ba8f-753131919eeb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:56.674275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082dfc0-a9a4-4dbc-ba8f-753131919eeb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:56.677785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc72da-0307-4ecb-a9ab-19ad726eab0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:56.678449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc72da-0307-4ecb-a9ab-19ad726eab0b service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:56.678731 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc72da-0307-4ecb-a9ab-19ad726eab0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:56.679006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc72da-0307-4ecb-a9ab-19ad726eab0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:56.688016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc72da-0307-4ecb-a9ab-19ad726eab0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:56.689545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc72da-0307-4ecb-a9ab-19ad726eab0b service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:56.698847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 730/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:34:58.922471 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470efad-6444-44ba-8277-52e6ffa7a805 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:58.923771 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470efad-6444-44ba-8277-52e6ffa7a805 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:58.923771 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470efad-6444-44ba-8277-52e6ffa7a805 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:58.925038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:34:58.930346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46895abd-055e-49c9-b075-eece57d1572d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:58.930782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46895abd-055e-49c9-b075-eece57d1572d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:58.930925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46895abd-055e-49c9-b075-eece57d1572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:58.937096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=70 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:34:58.949106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-46895abd-055e-49c9-b075-eece57d1572d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:34:58.959328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-46895abd-055e-49c9-b075-eece57d1572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:34:58.959328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:34:58.995104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470efad-6444-44ba-8277-52e6ffa7a805 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:34:59.000385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=73 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:34:59.006529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470efad-6444-44ba-8277-52e6ffa7a805 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:34:59.009918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e082374-8960-4e95-b24f-06905a942b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:34:59.013494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082374-8960-4e95-b24f-06905a942b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:34:59.013494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082374-8960-4e95-b24f-06905a942b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:34:59.013494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e082374-8960-4e95-b24f-06905a942b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:34:59.019761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e082374-8960-4e95-b24f-06905a942b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:34:59.021162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e082374-8960-4e95-b24f-06905a942b8c service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:34:59.031265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 730/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:01.290915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c902d6-6fca-47ac-94b1-145f2a60254d None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:01.291450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c902d6-6fca-47ac-94b1-145f2a60254d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:01.291450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c902d6-6fca-47ac-94b1-145f2a60254d None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:01.292733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:01.298396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b9e3-5716-4ae2-b30c-062f7317cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:01.298817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b9e3-5716-4ae2-b30c-062f7317cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:01.298985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552b9e3-5716-4ae2-b30c-062f7317cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:01.317558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1552b9e3-5716-4ae2-b30c-062f7317cbb7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:01.318774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1552b9e3-5716-4ae2-b30c-062f7317cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:01.326488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:01.364180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c902d6-6fca-47ac-94b1-145f2a60254d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:01.375217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c902d6-6fca-47ac-94b1-145f2a60254d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:01.379495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fbba21-1779-49e4-acf4-94b40d5dd9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:01.380123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbba21-1779-49e4-acf4-94b40d5dd9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:01.380400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbba21-1779-49e4-acf4-94b40d5dd9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:01.380672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fbba21-1779-49e4-acf4-94b40d5dd9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:01.389945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbba21-1779-49e4-acf4-94b40d5dd9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:01.392514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fbba21-1779-49e4-acf4-94b40d5dd9e5 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:01.401804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 733/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:03.605880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a04d7e-3e99-47fe-a0a9-25f5ff041f28 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:03.606379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a04d7e-3e99-47fe-a0a9-25f5ff041f28 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:03.606485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a04d7e-3e99-47fe-a0a9-25f5ff041f28 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:03.607829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:03.613557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bd1e-215e-4956-88ad-531aa0da3b70 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:03.614021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bd1e-215e-4956-88ad-531aa0da3b70 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:03.614124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bd1e-215e-4956-88ad-531aa0da3b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:03.632147 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a2a7bd1e-215e-4956-88ad-531aa0da3b70 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:03.633335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a2a7bd1e-215e-4956-88ad-531aa0da3b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:03.641184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:03.678393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a04d7e-3e99-47fe-a0a9-25f5ff041f28 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:03.689935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a04d7e-3e99-47fe-a0a9-25f5ff041f28 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:03.696770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ccfae-d340-48f2-a068-6c7e8a451566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:03.696770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ccfae-d340-48f2-a068-6c7e8a451566 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:03.696770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ccfae-d340-48f2-a068-6c7e8a451566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:03.696770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ccfae-d340-48f2-a068-6c7e8a451566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:03.703502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ccfae-d340-48f2-a068-6c7e8a451566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:03.705734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ccfae-d340-48f2-a068-6c7e8a451566 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:03.715188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 733/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:05.907900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e1cc-1c0a-43e0-afd9-d1d654a25e2c None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:05.908464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e1cc-1c0a-43e0-afd9-d1d654a25e2c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:05.908464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6e1cc-1c0a-43e0-afd9-d1d654a25e2c None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:05.909789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:05.915025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe93c8-0002-481e-b302-9c6bfb0541fd None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:05.915487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe93c8-0002-481e-b302-9c6bfb0541fd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:05.915589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe93c8-0002-481e-b302-9c6bfb0541fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:05.933343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c2fe93c8-0002-481e-b302-9c6bfb0541fd None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:05.934804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c2fe93c8-0002-481e-b302-9c6bfb0541fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:05.943176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:05.978720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6e1cc-1c0a-43e0-afd9-d1d654a25e2c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:05.990039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6e1cc-1c0a-43e0-afd9-d1d654a25e2c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:05.993497 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59107f3e-52ff-48a4-b54e-08e60dfa339e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:05.994156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59107f3e-52ff-48a4-b54e-08e60dfa339e service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:05.994436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59107f3e-52ff-48a4-b54e-08e60dfa339e service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:05.994709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59107f3e-52ff-48a4-b54e-08e60dfa339e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:06.003605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59107f3e-52ff-48a4-b54e-08e60dfa339e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:06.005028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59107f3e-52ff-48a4-b54e-08e60dfa339e service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:06.014366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 736/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:15.928284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=17 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:35:16.010227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=17 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:35:39.155180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666695-b343-4326-92e5-506eff230fbb None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:39.155787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666695-b343-4326-92e5-506eff230fbb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:39.155787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666695-b343-4326-92e5-506eff230fbb None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:39.157174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 735/1471] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:39.162255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0180-398c-444b-ad9a-67952d40d75f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:39.162673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0180-398c-444b-ad9a-67952d40d75f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:39.162806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0180-398c-444b-ad9a-67952d40d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:39.181084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-49fb0180-398c-444b-ad9a-67952d40d75f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:39.182232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-49fb0180-398c-444b-ad9a-67952d40d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:39.191232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 737/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:39.237521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57ea9f-6159-4174-9b37-e973c38b5f6e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:39.237852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57ea9f-6159-4174-9b37-e973c38b5f6e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:39.238160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57ea9f-6159-4174-9b37-e973c38b5f6e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:39.239518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 736/1473] 10.222.0.70 () {54 vars in 962 bytes} [Wed May 18 22:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:39.244281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215547-b81a-49c1-ae80-ac241450dfda None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:39.244566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215547-b81a-49c1-ae80-ac241450dfda None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:39.244839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47215547-b81a-49c1-ae80-ac241450dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:39.263584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-47215547-b81a-49c1-ae80-ac241450dfda None None] MFA Rules not processed for user `cc7d46c2766b4481963adefebea94c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:39.264753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-47215547-b81a-49c1-ae80-ac241450dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:39.271591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 738/1474] 10.222.0.70 () {58 vars in 1059 bytes} [Wed May 18 22:35:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:39.278616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57ea9f-6159-4174-9b37-e973c38b5f6e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:39.289529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57ea9f-6159-4174-9b37-e973c38b5f6e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:39.292982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27c3e5-ee1c-4ffa-83f8-32e7440d5fba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7d46c2766b4481963adefebea94c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:39.293587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c3e5-ee1c-4ffa-83f8-32e7440d5fba service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:39.293862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c3e5-ee1c-4ffa-83f8-32e7440d5fba service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:39.294177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27c3e5-ee1c-4ffa-83f8-32e7440d5fba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:39.303928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27c3e5-ee1c-4ffa-83f8-32e7440d5fba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:39.305320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27c3e5-ee1c-4ffa-83f8-32e7440d5fba service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:39.315513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 737/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:41.634895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9883679-6283-48c1-890f-3cc18c2622f4 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:41.635383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9883679-6283-48c1-890f-3cc18c2622f4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:41.635487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9883679-6283-48c1-890f-3cc18c2622f4 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:41.636846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 739/1476] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:41.642727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191c25-faa2-408b-9dec-a53299f90ac4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:41.643142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191c25-faa2-408b-9dec-a53299f90ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:41.643265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55191c25-faa2-408b-9dec-a53299f90ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:41.660675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-55191c25-faa2-408b-9dec-a53299f90ac4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:41.661837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-55191c25-faa2-408b-9dec-a53299f90ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:41.669457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 738/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:41.693253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9883679-6283-48c1-890f-3cc18c2622f4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:41.706304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9883679-6283-48c1-890f-3cc18c2622f4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:41.710822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1118a7-1c4e-4f7d-a6c6-bea63a2e6c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:41.711488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1118a7-1c4e-4f7d-a6c6-bea63a2e6c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:41.711771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1118a7-1c4e-4f7d-a6c6-bea63a2e6c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:41.712048 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1118a7-1c4e-4f7d-a6c6-bea63a2e6c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:41.712771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1118a7-1c4e-4f7d-a6c6-bea63a2e6c47 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:41.714573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING py.warnings [None req-fd1118a7-1c4e-4f7d-a6c6-bea63a2e6c47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:35:41.714573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: warnings.warn(msg) May 18 22:35:41.714573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: May 18 22:35:41.715709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1118a7-1c4e-4f7d-a6c6-bea63a2e6c47 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:41.734507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 740/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Wed May 18 22:35:41 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:35:44.065513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f86fe-b93c-4eaf-8b88-42b28e420baa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:44.066031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f86fe-b93c-4eaf-8b88-42b28e420baa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:44.066134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f86fe-b93c-4eaf-8b88-42b28e420baa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:44.067457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 739/1479] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:35:44.072676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294f60-b713-4867-969b-9b40146ba2bd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:44.073105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294f60-b713-4867-969b-9b40146ba2bd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:44.073261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294f60-b713-4867-969b-9b40146ba2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:44.091796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e7294f60-b713-4867-969b-9b40146ba2bd None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:44.092972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e7294f60-b713-4867-969b-9b40146ba2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:44.100826 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 741/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:44.145230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f86fe-b93c-4eaf-8b88-42b28e420baa None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:44.159520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f86fe-b93c-4eaf-8b88-42b28e420baa None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:44.165121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74198c-229d-4dd8-9ede-a8359f366221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:44.165750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74198c-229d-4dd8-9ede-a8359f366221 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:44.166055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74198c-229d-4dd8-9ede-a8359f366221 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:44.166332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74198c-229d-4dd8-9ede-a8359f366221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:44.175045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74198c-229d-4dd8-9ede-a8359f366221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:44.176607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74198c-229d-4dd8-9ede-a8359f366221 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:44.186188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 740/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:46.557977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3c334-a354-4bcc-8b0a-6fd81143b71f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:46.558838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3c334-a354-4bcc-8b0a-6fd81143b71f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:46.558838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3c334-a354-4bcc-8b0a-6fd81143b71f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:46.560163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 742/1482] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:46.565720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843a76-1182-4435-a59a-6f53b2951839 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:46.566209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843a76-1182-4435-a59a-6f53b2951839 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:46.566319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843a76-1182-4435-a59a-6f53b2951839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:46.584973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dd843a76-1182-4435-a59a-6f53b2951839 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:46.586194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dd843a76-1182-4435-a59a-6f53b2951839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:46.594302 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 741/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:46.629611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3c334-a354-4bcc-8b0a-6fd81143b71f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:46.640206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3c334-a354-4bcc-8b0a-6fd81143b71f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:46.644947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0502-048d-40ca-a64a-8b7398b6823a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:46.645569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0502-048d-40ca-a64a-8b7398b6823a service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:46.645849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0502-048d-40ca-a64a-8b7398b6823a service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:46.646159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0502-048d-40ca-a64a-8b7398b6823a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:46.654991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c0502-048d-40ca-a64a-8b7398b6823a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:46.657501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c0502-048d-40ca-a64a-8b7398b6823a service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:46.666915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 743/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:48.940867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fda79-503f-4f52-8f5c-377f7aaa4cc1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:48.941446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fda79-503f-4f52-8f5c-377f7aaa4cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:48.941446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fda79-503f-4f52-8f5c-377f7aaa4cc1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:48.942815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 742/1485] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:48.948103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e983f-47a9-4d14-9fb8-128b798a3e6b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:48.948512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e983f-47a9-4d14-9fb8-128b798a3e6b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:48.948658 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e983f-47a9-4d14-9fb8-128b798a3e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:48.966871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-004e983f-47a9-4d14-9fb8-128b798a3e6b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:48.968057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-004e983f-47a9-4d14-9fb8-128b798a3e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:48.976775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 744/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:49.013843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fda79-503f-4f52-8f5c-377f7aaa4cc1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:49.025191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fda79-503f-4f52-8f5c-377f7aaa4cc1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:49.028720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f696-4be4-4b3e-b565-962664f89a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:49.029344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f696-4be4-4b3e-b565-962664f89a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:49.029627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f696-4be4-4b3e-b565-962664f89a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:49.029904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f696-4be4-4b3e-b565-962664f89a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:49.039509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696f696-4be4-4b3e-b565-962664f89a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:49.040941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696f696-4be4-4b3e-b565-962664f89a52 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:49.050778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 743/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:51.395284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15891fe-1b50-40f0-9426-2049d8772bc7 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:51.395871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15891fe-1b50-40f0-9426-2049d8772bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:51.395871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15891fe-1b50-40f0-9426-2049d8772bc7 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:51.397182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 745/1488] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:51.402720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e229-e4ea-44e0-b2c4-8f7359966021 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:51.403209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e229-e4ea-44e0-b2c4-8f7359966021 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:51.403316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25e229-e4ea-44e0-b2c4-8f7359966021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:51.423243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1f25e229-e4ea-44e0-b2c4-8f7359966021 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:51.424433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1f25e229-e4ea-44e0-b2c4-8f7359966021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:51.432227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 744/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:51.474868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15891fe-1b50-40f0-9426-2049d8772bc7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:51.486072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15891fe-1b50-40f0-9426-2049d8772bc7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:51.489509 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305049cb-f1f8-4e8e-a932-46b6833c02c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:51.490157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305049cb-f1f8-4e8e-a932-46b6833c02c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:51.490435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305049cb-f1f8-4e8e-a932-46b6833c02c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:51.490704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305049cb-f1f8-4e8e-a932-46b6833c02c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:51.499319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305049cb-f1f8-4e8e-a932-46b6833c02c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:51.501419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305049cb-f1f8-4e8e-a932-46b6833c02c5 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:51.510679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 746/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:35:54.112187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddb7b4-04dd-42d1-854f-e06463125b22 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:54.112707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddb7b4-04dd-42d1-854f-e06463125b22 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:54.112812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddb7b4-04dd-42d1-854f-e06463125b22 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:54.114168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 745/1491] 10.222.0.70 () {54 vars in 926 bytes} [Wed May 18 22:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:35:54.119265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7596c83-d166-45af-acd7-db146b3729e3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:54.119678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7596c83-d166-45af-acd7-db146b3729e3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:54.119822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7596c83-d166-45af-acd7-db146b3729e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:54.137822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c7596c83-d166-45af-acd7-db146b3729e3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:35:54.139038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c7596c83-d166-45af-acd7-db146b3729e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:35:54.147034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 747/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Wed May 18 22:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:35:54.186044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddb7b4-04dd-42d1-854f-e06463125b22 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:35:54.197327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddb7b4-04dd-42d1-854f-e06463125b22 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:35:54.200831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e89e2-96e6-4a36-b36d-65ea648c9cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:35:54.201458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e89e2-96e6-4a36-b36d-65ea648c9cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:35:54.201738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e89e2-96e6-4a36-b36d-65ea648c9cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:35:54.202031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e89e2-96e6-4a36-b36d-65ea648c9cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:35:54.210838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e89e2-96e6-4a36-b36d-65ea648c9cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:35:54.212241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e89e2-96e6-4a36-b36d-65ea648c9cc9 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:35:54.221598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 746/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:36:04.132795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=33 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:36:04.217400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=33 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:37:41.700917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3375d87-3c6a-4915-8497-184406a943b5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:41.701403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3375d87-3c6a-4915-8497-184406a943b5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:41.701505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3375d87-3c6a-4915-8497-184406a943b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:41.719779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d3375d87-3c6a-4915-8497-184406a943b5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:37:41.720949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d3375d87-3c6a-4915-8497-184406a943b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:37:41.728550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 748/1494] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:37:41.738077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837a308-0259-4e88-b540-9b59a06c3fce None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:41.738554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837a308-0259-4e88-b540-9b59a06c3fce None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:41.738757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837a308-0259-4e88-b540-9b59a06c3fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:41.756918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7837a308-0259-4e88-b540-9b59a06c3fce None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:37:41.758138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7837a308-0259-4e88-b540-9b59a06c3fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:37:41.765785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 747/1495] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:37:41.770770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3375d87-3c6a-4915-8497-184406a943b5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:41.780100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3375d87-3c6a-4915-8497-184406a943b5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:41.784529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:41.785162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:41.785435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:41.785701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:41.786440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:37:41.786740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:41.787754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING py.warnings [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:37:41.787754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: warnings.warn(msg) May 18 22:37:41.787754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: May 18 22:37:41.788611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:41.800021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 749/1496] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:37:41.808090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837a308-0259-4e88-b540-9b59a06c3fce None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:41.817570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837a308-0259-4e88-b540-9b59a06c3fce None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:41.822075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:41.822715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:41.822995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:41.823266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:41.823945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:41.825669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WARNING py.warnings [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:37:41.825669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: warnings.warn(msg) May 18 22:37:41.825669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: May 18 22:37:41.826875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:41.918851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 748/1497] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:37:41 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:37:41.923118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:41.933073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2e1af-2cea-456f-a68c-fe1f0137c593 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:41.988260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:41.988841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:41.989117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:41.989382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:41.990082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:41.991091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING py.warnings [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:37:41.991091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: warnings.warn(msg) May 18 22:37:41.991091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: May 18 22:37:41.992273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:42.060654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 750/1498] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:37:41 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:37:42.066904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:42.077425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f229d3-2e2d-4689-b2ed-6b26ccaf39af admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:42.082281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:42.082923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.083206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.083477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.084192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:42.085189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WARNING py.warnings [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:37:42.085189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: warnings.warn(msg) May 18 22:37:42.085189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: May 18 22:37:42.086117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:42.098996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 749/1499] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:37:42.103249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:42.114404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89cb86-a656-4a33-b3af-36fe29ce61fc admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:42.119182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc06f9-26a6-48f1-8019-984ae58d55e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:42.119832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc06f9-26a6-48f1-8019-984ae58d55e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.120114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc06f9-26a6-48f1-8019-984ae58d55e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.120391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc06f9-26a6-48f1-8019-984ae58d55e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.121105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc06f9-26a6-48f1-8019-984ae58d55e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:42.122158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING py.warnings [None req-fbcc06f9-26a6-48f1-8019-984ae58d55e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:37:42.122158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: warnings.warn(msg) May 18 22:37:42.122158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: May 18 22:37:42.123041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc06f9-26a6-48f1-8019-984ae58d55e7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:42.138332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 751/1500] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:37:42.146194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:42.156279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae65613-e7b5-4de6-8330-b9376e9b00fe admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:42.161097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9265b9-614d-483c-8de7-117a645334eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:42.162014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9265b9-614d-483c-8de7-117a645334eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.162305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9265b9-614d-483c-8de7-117a645334eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.162575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9265b9-614d-483c-8de7-117a645334eb admin admin] PATH_INFO: `/v3/projects/da5de97b065046fb937fc3febbf6c7d8/users/6ec33b3f0d114fc0aa9fa58a070840bb/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.177962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9265b9-614d-483c-8de7-117a645334eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5de97b065046fb937fc3febbf6c7d8, user_id=6ec33b3f0d114fc0aa9fa58a070840bb, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:42.179009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WARNING py.warnings [None req-bf9265b9-614d-483c-8de7-117a645334eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:37:42.179009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: warnings.warn(msg) May 18 22:37:42.179009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: May 18 22:37:42.180903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9265b9-614d-483c-8de7-117a645334eb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:42.249589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 750/1501] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:37:42 2022] PUT /identity/v3/projects/da5de97b065046fb937fc3febbf6c7d8/users/6ec33b3f0d114fc0aa9fa58a070840bb/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:37:42.262243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70bae-0a70-4d0f-b3de-75035ca58ae5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.262571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70bae-0a70-4d0f-b3de-75035ca58ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.262788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b70bae-0a70-4d0f-b3de-75035ca58ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.289739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-54b70bae-0a70-4d0f-b3de-75035ca58ae5 None None] MFA Rules not processed for user `6ec33b3f0d114fc0aa9fa58a070840bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:37:42.290993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-54b70bae-0a70-4d0f-b3de-75035ca58ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:37:42.359224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 752/1502] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:37:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:37:42.374569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c199c-38ea-42d3-9862-7aaee379bbb6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.374861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c199c-38ea-42d3-9862-7aaee379bbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.381476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c199c-38ea-42d3-9862-7aaee379bbb6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.381476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 751/1503] 10.222.0.70 () {54 vars in 963 bytes} [Wed May 18 22:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:37:42.381928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afe8f-9b12-4acd-ab75-fd9cf82eec0a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.382246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afe8f-9b12-4acd-ab75-fd9cf82eec0a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.382523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04afe8f-9b12-4acd-ab75-fd9cf82eec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.402214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c04afe8f-9b12-4acd-ab75-fd9cf82eec0a None None] MFA Rules not processed for user `fe4941cd1afb4318b42263390025d198`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:37:42.403445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c04afe8f-9b12-4acd-ab75-fd9cf82eec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:37:42.449947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:37:42.458028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 753/1504] 10.222.0.70 () {58 vars in 1060 bytes} [Wed May 18 22:37:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:37:42.465949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c199c-38ea-42d3-9862-7aaee379bbb6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:42.477744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c199c-38ea-42d3-9862-7aaee379bbb6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:42.481611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31c5b-8950-438b-b748-ddca6fa16904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:42.482269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31c5b-8950-438b-b748-ddca6fa16904 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.482547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31c5b-8950-438b-b748-ddca6fa16904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.482815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31c5b-8950-438b-b748-ddca6fa16904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.492345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa31c5b-8950-438b-b748-ddca6fa16904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:42.493752 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa31c5b-8950-438b-b748-ddca6fa16904 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:42.503362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 752/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:37:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:37:42.549973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d57919-7469-426b-9543-76d1b9a39ed6 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.550292 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d57919-7469-426b-9543-76d1b9a39ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.550568 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d57919-7469-426b-9543-76d1b9a39ed6 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.551850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 754/1506] 10.222.0.70 () {52 vars in 829 bytes} [Wed May 18 22:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:37:42.555597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31c5b-8950-438b-b748-ddca6fa16904 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:42.621311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31c5b-8950-438b-b748-ddca6fa16904 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:42.625975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:42.626938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.627410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.627904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] PATH_INFO: `/v3/users/6ec33b3f0d114fc0aa9fa58a070840bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.629947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec33b3f0d114fc0aa9fa58a070840bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:42.631795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WARNING py.warnings [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:37:42.631795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: warnings.warn(msg) May 18 22:37:42.631795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: May 18 22:37:42.633126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:42.813099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec33b3f0d114fc0aa9fa58a070840bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:42.872097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec33b3f0d114fc0aa9fa58a070840bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:42.884864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec33b3f0d114fc0aa9fa58a070840bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:42.885663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec33b3f0d114fc0aa9fa58a070840bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:42.902869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:37:42.905467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec33b3f0d114fc0aa9fa58a070840bb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:42.912188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 753/1507] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:37:42 2022] DELETE /identity/v3/users/6ec33b3f0d114fc0aa9fa58a070840bb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:37:42.916593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe28a8b-23c6-470f-a9ab-a3fff934a6f7 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:42.919189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe28a8b-23c6-470f-a9ab-a3fff934a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:42.919189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe28a8b-23c6-470f-a9ab-a3fff934a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:42.934989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8fe28a8b-23c6-470f-a9ab-a3fff934a6f7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:37:42.936184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8fe28a8b-23c6-470f-a9ab-a3fff934a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:37:42.998935 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 755/1508] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:37:43.008745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:43.010198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:37:43.069762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61259b-19c7-4619-ac97-c00b96d1d09b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:43.073309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2968-db48-48a6-b513-6a9bbc742f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:43.073958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2968-db48-48a6-b513-6a9bbc742f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:43.074270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2968-db48-48a6-b513-6a9bbc742f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:43.074592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2968-db48-48a6-b513-6a9bbc742f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:43.084311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2968-db48-48a6-b513-6a9bbc742f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:43.085743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2968-db48-48a6-b513-6a9bbc742f4b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:43.096114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 754/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:37:43.530102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe28a8b-23c6-470f-a9ab-a3fff934a6f7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:37:43.531993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8fe28a8b-23c6-470f-a9ab-a3fff934a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:37:43.544401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe28a8b-23c6-470f-a9ab-a3fff934a6f7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:37:43.550593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:37:43.551496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:37:43.551778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:37:43.552050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] PATH_INFO: `/v3/projects/da5de97b065046fb937fc3febbf6c7d8` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:37:43.553392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5de97b065046fb937fc3febbf6c7d8)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:37:43.554483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING py.warnings [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:37:43.554483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: warnings.warn(msg) May 18 22:37:43.554483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: May 18 22:37:43.555670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:37:43.700666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5de97b065046fb937fc3febbf6c7d8', 'request_id': 'req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:43.780555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5de97b065046fb937fc3febbf6c7d8', 'request_id': 'req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:43.787014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5de97b065046fb937fc3febbf6c7d8', 'request_id': 'req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:43.805475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] The token cache is being invalidate because project da5de97b065046fb937fc3febbf6c7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:37:43.805758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:43.806523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-85e4a77f-6139-41bf-a7ca-b37dc4c3ae3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:37:43.808332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 756/1510] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:37:43 2022] DELETE /identity/v3/projects/da5de97b065046fb937fc3febbf6c7d8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:37:53.215328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:37:53.802507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:39:22.492673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44976c11-3cbd-4b9c-b083-7a1c4322b7cc None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:22.493279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44976c11-3cbd-4b9c-b083-7a1c4322b7cc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:22.493279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44976c11-3cbd-4b9c-b083-7a1c4322b7cc None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:22.494631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:22.499438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc293e-05f0-4661-9059-81767c8a2c07 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:22.499904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc293e-05f0-4661-9059-81767c8a2c07 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:22.500017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc293e-05f0-4661-9059-81767c8a2c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:22.518289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-45cc293e-05f0-4661-9059-81767c8a2c07 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:22.519477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-45cc293e-05f0-4661-9059-81767c8a2c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:22.577044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:39:22.754800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44976c11-3cbd-4b9c-b083-7a1c4322b7cc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:22.756477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-44976c11-3cbd-4b9c-b083-7a1c4322b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:22.832994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44976c11-3cbd-4b9c-b083-7a1c4322b7cc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:22.838592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16b2f-0276-456d-ab3a-5a13afa035cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:22.839235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16b2f-0276-456d-ab3a-5a13afa035cf service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:22.839522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16b2f-0276-456d-ab3a-5a13afa035cf service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:22.839805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16b2f-0276-456d-ab3a-5a13afa035cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:22.848762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b16b2f-0276-456d-ab3a-5a13afa035cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:22.850417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b16b2f-0276-456d-ab3a-5a13afa035cf service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:22.860313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 756/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:23.763655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c304b89-9154-4060-8ba7-0092a7346849 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:23.764128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c304b89-9154-4060-8ba7-0092a7346849 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:23.764232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c304b89-9154-4060-8ba7-0092a7346849 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:23.766173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:23.770900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c492-2686-46af-9275-a5ed1d99f465 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:23.771341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c492-2686-46af-9275-a5ed1d99f465 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:23.771450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093c492-2686-46af-9275-a5ed1d99f465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:23.791464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f093c492-2686-46af-9275-a5ed1d99f465 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:23.792672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f093c492-2686-46af-9275-a5ed1d99f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:23.800865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:39:23.953333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c304b89-9154-4060-8ba7-0092a7346849 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:23.967438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c304b89-9154-4060-8ba7-0092a7346849 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:23.972769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66277f-f58f-4d06-ae43-48e8b1203631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:23.973395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66277f-f58f-4d06-ae43-48e8b1203631 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:23.973678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66277f-f58f-4d06-ae43-48e8b1203631 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:23.973956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66277f-f58f-4d06-ae43-48e8b1203631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:23.982062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66277f-f58f-4d06-ae43-48e8b1203631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:23.984189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66277f-f58f-4d06-ae43-48e8b1203631 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:23.993613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 759/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:24.674535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff53f6-ee2b-4b3e-817f-c810630df73b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:24.674819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff53f6-ee2b-4b3e-817f-c810630df73b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:24.675092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff53f6-ee2b-4b3e-817f-c810630df73b None None] PATH_INFO: `/v3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:24.676471 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 758/1517] 10.222.0.24 () {54 vars in 925 bytes} [Wed May 18 22:39:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:39:24.683102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90198ae-11d9-4fc3-9021-9ca130e0f049 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:24.683390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90198ae-11d9-4fc3-9021-9ca130e0f049 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:24.683670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90198ae-11d9-4fc3-9021-9ca130e0f049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:24.704119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e90198ae-11d9-4fc3-9021-9ca130e0f049 None None] MFA Rules not processed for user `e234faadf42946058f41bd8e7b43408a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:24.705328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e90198ae-11d9-4fc3-9021-9ca130e0f049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:24.766806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 760/1518] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 18 22:39:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:39:33.784118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=37 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:39:34.171481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cab6d-0ddc-4b47-8d23-0dadc60e1ce4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:34.171762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cab6d-0ddc-4b47-8d23-0dadc60e1ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:34.172042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cab6d-0ddc-4b47-8d23-0dadc60e1ce4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:34.173486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 759/1519] 10.222.0.70 () {54 vars in 960 bytes} [Wed May 18 22:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:34.178607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e713-fe05-495d-9227-755963b62c43 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:34.179097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e713-fe05-495d-9227-755963b62c43 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:34.179210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2e713-fe05-495d-9227-755963b62c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:34.197015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-76f2e713-fe05-495d-9227-755963b62c43 None None] MFA Rules not processed for user `e234faadf42946058f41bd8e7b43408a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:34.198217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-76f2e713-fe05-495d-9227-755963b62c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:34.207433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 761/1520] 10.222.0.70 () {58 vars in 1057 bytes} [Wed May 18 22:39:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:39:34.213993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cab6d-0ddc-4b47-8d23-0dadc60e1ce4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:34.227765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cab6d-0ddc-4b47-8d23-0dadc60e1ce4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:34.232546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007199b-640c-4dbf-949f-311f4b0b1048 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:34.233822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007199b-640c-4dbf-949f-311f4b0b1048 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:34.234134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007199b-640c-4dbf-949f-311f4b0b1048 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:34.234407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007199b-640c-4dbf-949f-311f4b0b1048 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:34.243382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007199b-640c-4dbf-949f-311f4b0b1048 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:34.245114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007199b-640c-4dbf-949f-311f4b0b1048 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:34.256289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 760/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:35.322895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a81d-5651-479b-a2bc-4494010f745d None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:35.323434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a81d-5651-479b-a2bc-4494010f745d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:35.323434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a81d-5651-479b-a2bc-4494010f745d None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:35.324776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:35.330298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c5f18-497c-4db6-8026-cf588570b8d9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:35.330714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c5f18-497c-4db6-8026-cf588570b8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:35.330887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c5f18-497c-4db6-8026-cf588570b8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:35.349146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e63c5f18-497c-4db6-8026-cf588570b8d9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:35.350406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e63c5f18-497c-4db6-8026-cf588570b8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:35.358446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:39:35.513419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a81d-5651-479b-a2bc-4494010f745d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:35.527483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a81d-5651-479b-a2bc-4494010f745d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:35.533206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879af5f-5b7a-4ccc-928a-bb413e349783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:35.533832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879af5f-5b7a-4ccc-928a-bb413e349783 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:35.534222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879af5f-5b7a-4ccc-928a-bb413e349783 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:35.534491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879af5f-5b7a-4ccc-928a-bb413e349783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:35.542953 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879af5f-5b7a-4ccc-928a-bb413e349783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:35.544554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879af5f-5b7a-4ccc-928a-bb413e349783 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:35.554567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 763/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:36.432669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b7f88-bbb1-47bb-8cb9-3562d3e616a3 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:36.433270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b7f88-bbb1-47bb-8cb9-3562d3e616a3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:36.433270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b7f88-bbb1-47bb-8cb9-3562d3e616a3 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:36.434637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 22:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:36.440112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258925-932b-40d9-bce1-e83e99a570bb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:36.440600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258925-932b-40d9-bce1-e83e99a570bb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:36.440712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258925-932b-40d9-bce1-e83e99a570bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:36.458735 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-82258925-932b-40d9-bce1-e83e99a570bb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:36.459899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-82258925-932b-40d9-bce1-e83e99a570bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:36.468239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 22:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:39:36.617924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b7f88-bbb1-47bb-8cb9-3562d3e616a3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:36.632674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b7f88-bbb1-47bb-8cb9-3562d3e616a3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:36.638370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db570db2-23bc-46d7-b9a7-2091f0934568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:36.638997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570db2-23bc-46d7-b9a7-2091f0934568 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:36.639884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570db2-23bc-46d7-b9a7-2091f0934568 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:36.640162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570db2-23bc-46d7-b9a7-2091f0934568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:36.648308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570db2-23bc-46d7-b9a7-2091f0934568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:36.651255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db570db2-23bc-46d7-b9a7-2091f0934568 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:36.659480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 763/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:40.645035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf21a-2a9c-462b-9621-820b79b1abf2 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:40.645583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf21a-2a9c-462b-9621-820b79b1abf2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:40.645583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf21a-2a9c-462b-9621-820b79b1abf2 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:40.647159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:40.652486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c472-8f82-4008-a314-cc4258504b41 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:40.652913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c472-8f82-4008-a314-cc4258504b41 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:40.653143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c472-8f82-4008-a314-cc4258504b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:40.671707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b5c4c472-8f82-4008-a314-cc4258504b41 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:40.676134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b5c4c472-8f82-4008-a314-cc4258504b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:40.680844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:39:40.718140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdf21a-2a9c-462b-9621-820b79b1abf2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:40.719863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-92cdf21a-2a9c-462b-9621-820b79b1abf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:40.788611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdf21a-2a9c-462b-9621-820b79b1abf2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:40.792181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef247bb2-bd24-4d20-b156-435a001ee9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:40.792817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247bb2-bd24-4d20-b156-435a001ee9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:40.793103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247bb2-bd24-4d20-b156-435a001ee9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:40.793377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef247bb2-bd24-4d20-b156-435a001ee9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:40.802588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247bb2-bd24-4d20-b156-435a001ee9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:40.804007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef247bb2-bd24-4d20-b156-435a001ee9b2 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:40.809200 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:39:40.814768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 766/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:43.024617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85fb3-108b-4be0-9c75-2298f35afe55 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:43.025261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85fb3-108b-4be0-9c75-2298f35afe55 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:43.025261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85fb3-108b-4be0-9c75-2298f35afe55 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:43.026591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:43.032059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd049278-fff4-4c8e-8e9f-df17a0925969 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:43.032501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd049278-fff4-4c8e-8e9f-df17a0925969 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:43.032607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd049278-fff4-4c8e-8e9f-df17a0925969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:43.051424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-dd049278-fff4-4c8e-8e9f-df17a0925969 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:43.052604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-dd049278-fff4-4c8e-8e9f-df17a0925969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:43.060702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:39:43.097569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba85fb3-108b-4be0-9c75-2298f35afe55 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:43.099286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eba85fb3-108b-4be0-9c75-2298f35afe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:43.112830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba85fb3-108b-4be0-9c75-2298f35afe55 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:43.116265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256c339-e06b-43bd-a05a-3c9dd6ab3342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:43.116891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c339-e06b-43bd-a05a-3c9dd6ab3342 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:43.117168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c339-e06b-43bd-a05a-3c9dd6ab3342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:43.117436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256c339-e06b-43bd-a05a-3c9dd6ab3342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:43.126516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c339-e06b-43bd-a05a-3c9dd6ab3342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:43.127923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256c339-e06b-43bd-a05a-3c9dd6ab3342 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:43.137030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 766/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:46.990798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3cd00-3108-4815-b2b3-df173245300e None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:46.991359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3cd00-3108-4815-b2b3-df173245300e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:46.991359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3cd00-3108-4815-b2b3-df173245300e None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:46.992719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:46.997869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172222c-e8ac-4c60-969d-b785a428f1aa None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:46.998286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172222c-e8ac-4c60-969d-b785a428f1aa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:46.999157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172222c-e8ac-4c60-969d-b785a428f1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:47.017352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e172222c-e8ac-4c60-969d-b785a428f1aa None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:47.018579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e172222c-e8ac-4c60-969d-b785a428f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:47.026305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:39:47.302590 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3cd00-3108-4815-b2b3-df173245300e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:47.304273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3fd3cd00-3108-4815-b2b3-df173245300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:47.361834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3cd00-3108-4815-b2b3-df173245300e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:47.365375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2809a28-f4ce-4b60-967e-54d4c29319ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:47.366028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809a28-f4ce-4b60-967e-54d4c29319ef service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:47.366325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809a28-f4ce-4b60-967e-54d4c29319ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:47.366598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2809a28-f4ce-4b60-967e-54d4c29319ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:47.375462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2809a28-f4ce-4b60-967e-54d4c29319ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:47.376883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2809a28-f4ce-4b60-967e-54d4c29319ef service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:47.386206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 769/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:49.652189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950d788-f749-4887-9725-2f6eeb324c8d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:49.652765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950d788-f749-4887-9725-2f6eeb324c8d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:49.652765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950d788-f749-4887-9725-2f6eeb324c8d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:49.654111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 22:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:39:49.660511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518084a-2d8a-4f26-a7b4-d60998c6e512 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:49.660951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518084a-2d8a-4f26-a7b4-d60998c6e512 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:49.661098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518084a-2d8a-4f26-a7b4-d60998c6e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:49.678834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8518084a-2d8a-4f26-a7b4-d60998c6e512 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:39:49.680019 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8518084a-2d8a-4f26-a7b4-d60998c6e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:49.688224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 22:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:39:49.957350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950d788-f749-4887-9725-2f6eeb324c8d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:39:49.959106 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6950d788-f749-4887-9725-2f6eeb324c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:39:49.972086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950d788-f749-4887-9725-2f6eeb324c8d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:39:49.975652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ab4a3-d575-46ab-bdb4-4bcca5b0894f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:39:49.976310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab4a3-d575-46ab-bdb4-4bcca5b0894f service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:39:49.976589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab4a3-d575-46ab-bdb4-4bcca5b0894f service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:39:49.976890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab4a3-d575-46ab-bdb4-4bcca5b0894f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:39:49.986055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ab4a3-d575-46ab-bdb4-4bcca5b0894f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:39:49.987465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ab4a3-d575-46ab-bdb4-4bcca5b0894f service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:39:49.996647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 769/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:39:59.673680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=32 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:39:59.992539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=33 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:21.064716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fc01-4235-4947-bb53-7acd09fff169 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.065689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fc01-4235-4947-bb53-7acd09fff169 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.066219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fc01-4235-4947-bb53-7acd09fff169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.102424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4dd0fc01-4235-4947-bb53-7acd09fff169 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.104001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4dd0fc01-4235-4947-bb53-7acd09fff169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.117666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 771/1540] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.128444 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32195df-4c9c-4658-9d43-07654763482b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.129468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32195df-4c9c-4658-9d43-07654763482b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.129962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32195df-4c9c-4658-9d43-07654763482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.154124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d32195df-4c9c-4658-9d43-07654763482b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.156248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d32195df-4c9c-4658-9d43-07654763482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.174470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 770/1541] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.183099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0fc01-4235-4947-bb53-7acd09fff169 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:21.194162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0fc01-4235-4947-bb53-7acd09fff169 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:21.201873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69468e40-e9ff-41aa-898c-2c2fafebd0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:21.202880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468e40-e9ff-41aa-898c-2c2fafebd0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.203379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468e40-e9ff-41aa-898c-2c2fafebd0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.203975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69468e40-e9ff-41aa-898c-2c2fafebd0e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.204920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69468e40-e9ff-41aa-898c-2c2fafebd0e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:21.205439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69468e40-e9ff-41aa-898c-2c2fafebd0e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:21.207292 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69468e40-e9ff-41aa-898c-2c2fafebd0e7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:21.229921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 772/1542] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:21.242347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32195df-4c9c-4658-9d43-07654763482b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:21.264606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32195df-4c9c-4658-9d43-07654763482b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:21.271526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7fe3-d430-4241-8a1a-fd215398f63f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.272296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7fe3-d430-4241-8a1a-fd215398f63f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.272789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7fe3-d430-4241-8a1a-fd215398f63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.296461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05e48-b1a9-4df0-82d7-20bfd3b03457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:21.297529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05e48-b1a9-4df0-82d7-20bfd3b03457 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.299844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05e48-b1a9-4df0-82d7-20bfd3b03457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.300454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05e48-b1a9-4df0-82d7-20bfd3b03457 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.301425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05e48-b1a9-4df0-82d7-20bfd3b03457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:21.303621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05e48-b1a9-4df0-82d7-20bfd3b03457 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:21.310101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-015b7fe3-d430-4241-8a1a-fd215398f63f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.310101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-015b7fe3-d430-4241-8a1a-fd215398f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.355176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 773/1543] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.356602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe82a8-8800-446c-b98b-02a16b93dce1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.356876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe82a8-8800-446c-b98b-02a16b93dce1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.357152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe82a8-8800-446c-b98b-02a16b93dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.399452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2bfe82a8-8800-446c-b98b-02a16b93dce1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.401498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2bfe82a8-8800-446c-b98b-02a16b93dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.421872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 774/1544] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.423306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc67a8-87f0-41a0-bde7-6048387f663f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.423586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc67a8-87f0-41a0-bde7-6048387f663f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.423855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc67a8-87f0-41a0-bde7-6048387f663f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.446157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 771/1545] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:21.448413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9aa38-2720-4efd-9c4a-5a71e2269562 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.448948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9aa38-2720-4efd-9c4a-5a71e2269562 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.449447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9aa38-2720-4efd-9c4a-5a71e2269562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.466176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-23dc67a8-87f0-41a0-bde7-6048387f663f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.467636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-23dc67a8-87f0-41a0-bde7-6048387f663f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.492422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7cd9aa38-2720-4efd-9c4a-5a71e2269562 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.492422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7cd9aa38-2720-4efd-9c4a-5a71e2269562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.665981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 775/1546] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.667881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc67a8-87f0-41a0-bde7-6048387f663f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:21.677136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 772/1547] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.678576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50f01-f946-4bbc-ae9b-8c1c9c4bfbaa None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.678868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50f01-f946-4bbc-ae9b-8c1c9c4bfbaa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.679149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a50f01-f946-4bbc-ae9b-8c1c9c4bfbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.688654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc67a8-87f0-41a0-bde7-6048387f663f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:21.696117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d71d7-9ea4-4fd3-a08c-5206160b8f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:21.696898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d71d7-9ea4-4fd3-a08c-5206160b8f74 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.697181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d71d7-9ea4-4fd3-a08c-5206160b8f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.697547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d71d7-9ea4-4fd3-a08c-5206160b8f74 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.698188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d71d7-9ea4-4fd3-a08c-5206160b8f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:21.700291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d71d7-9ea4-4fd3-a08c-5206160b8f74 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:21.704550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-40a50f01-f946-4bbc-ae9b-8c1c9c4bfbaa None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.705960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-40a50f01-f946-4bbc-ae9b-8c1c9c4bfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.721127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 773/1548] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.722917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7452-63e3-41bd-8428-9b35520da9a4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.723207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7452-63e3-41bd-8428-9b35520da9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.723489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7452-63e3-41bd-8428-9b35520da9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.742229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-94ae7452-63e3-41bd-8428-9b35520da9a4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.745770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-94ae7452-63e3-41bd-8428-9b35520da9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.752634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 774/1549] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.753610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae7452-63e3-41bd-8428-9b35520da9a4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:21.763739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae7452-63e3-41bd-8428-9b35520da9a4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:21.768718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fe84a-aec5-4949-8232-8499fc7995d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:21.769384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe84a-aec5-4949-8232-8499fc7995d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.769666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe84a-aec5-4949-8232-8499fc7995d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.769939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fe84a-aec5-4949-8232-8499fc7995d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.770694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe84a-aec5-4949-8232-8499fc7995d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:21.770995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe84a-aec5-4949-8232-8499fc7995d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:21.772042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WARNING py.warnings [None req-433fe84a-aec5-4949-8232-8499fc7995d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:41:21.772042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: warnings.warn(msg) May 18 22:41:21.772042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: May 18 22:41:21.775353 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 776/1550] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:21.780142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fe84a-aec5-4949-8232-8499fc7995d2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:21.780293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d71d7-9ea4-4fd3-a08c-5206160b8f74 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:21.782905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d71d7-9ea4-4fd3-a08c-5206160b8f74 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:21.785065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 775/1551] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:21.786332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897746-f8cc-48dd-b5d4-5c488997ee06 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.786652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897746-f8cc-48dd-b5d4-5c488997ee06 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.786891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3897746-f8cc-48dd-b5d4-5c488997ee06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.787600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe784f7-ab88-4b1f-9c07-d171ac4f0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:21.788641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe784f7-ab88-4b1f-9c07-d171ac4f0626 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.788918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe784f7-ab88-4b1f-9c07-d171ac4f0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.789184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe784f7-ab88-4b1f-9c07-d171ac4f0626 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.790111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe784f7-ab88-4b1f-9c07-d171ac4f0626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:21.790431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe784f7-ab88-4b1f-9c07-d171ac4f0626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:21.792254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe784f7-ab88-4b1f-9c07-d171ac4f0626 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:21.806086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 777/1552] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:21.808854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b3897746-f8cc-48dd-b5d4-5c488997ee06 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.808981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74158411-a5c3-4569-9b2e-f29ce178fb38 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.808981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74158411-a5c3-4569-9b2e-f29ce178fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.809155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b3897746-f8cc-48dd-b5d4-5c488997ee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.809237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74158411-a5c3-4569-9b2e-f29ce178fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.817259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 776/1553] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.818527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e698c6-b770-4647-ba9c-90482c064c2f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.818815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e698c6-b770-4647-ba9c-90482c064c2f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.819098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e698c6-b770-4647-ba9c-90482c064c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.828162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-74158411-a5c3-4569-9b2e-f29ce178fb38 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.829375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-74158411-a5c3-4569-9b2e-f29ce178fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.837251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 778/1554] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.837391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-49e698c6-b770-4647-ba9c-90482c064c2f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.838516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-49e698c6-b770-4647-ba9c-90482c064c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.838643 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11f8f-5ff5-4ffe-b74e-4a91a0c03389 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.838884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11f8f-5ff5-4ffe-b74e-4a91a0c03389 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.839153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef11f8f-5ff5-4ffe-b74e-4a91a0c03389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.852269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 777/1555] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.853615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76d44-a95f-4bc2-acea-0d348d26fce7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.853903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76d44-a95f-4bc2-acea-0d348d26fce7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.854203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da76d44-a95f-4bc2-acea-0d348d26fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.859230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5ef11f8f-5ff5-4ffe-b74e-4a91a0c03389 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.860461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5ef11f8f-5ff5-4ffe-b74e-4a91a0c03389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.868352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 779/1556] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.869123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef11f8f-5ff5-4ffe-b74e-4a91a0c03389 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:21.872708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7da76d44-a95f-4bc2-acea-0d348d26fce7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:21.874042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7da76d44-a95f-4bc2-acea-0d348d26fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:21.879274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef11f8f-5ff5-4ffe-b74e-4a91a0c03389 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:21.882413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 778/1557] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:21.883266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da76d44-a95f-4bc2-acea-0d348d26fce7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:21.887135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a56aa-2f2a-4721-b847-cfb5180074df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:21.887790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a56aa-2f2a-4721-b847-cfb5180074df admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.888074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a56aa-2f2a-4721-b847-cfb5180074df admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.888348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a56aa-2f2a-4721-b847-cfb5180074df admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.889373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a56aa-2f2a-4721-b847-cfb5180074df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:21.891018 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a56aa-2f2a-4721-b847-cfb5180074df admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:21.893232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da76d44-a95f-4bc2-acea-0d348d26fce7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:21.897813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7fb20-04b8-41b1-a64a-b7fbf32e6105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:21.898497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fb20-04b8-41b1-a64a-b7fbf32e6105 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.898778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fb20-04b8-41b1-a64a-b7fbf32e6105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.899048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fb20-04b8-41b1-a64a-b7fbf32e6105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.899726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7fb20-04b8-41b1-a64a-b7fbf32e6105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:21.904437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 780/1558] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:21.904641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7fb20-04b8-41b1-a64a-b7fbf32e6105 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:21.904750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a56aa-2f2a-4721-b847-cfb5180074df admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:21.913552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a56aa-2f2a-4721-b847-cfb5180074df admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:21.918430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87009367-eb6d-4daa-9638-76b4bca6c0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:21.919001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009367-eb6d-4daa-9638-76b4bca6c0ed admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:21.919277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009367-eb6d-4daa-9638-76b4bca6c0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:21.919544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87009367-eb6d-4daa-9638-76b4bca6c0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:21.920761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87009367-eb6d-4daa-9638-76b4bca6c0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:21.921765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING py.warnings [None req-87009367-eb6d-4daa-9638-76b4bca6c0ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:41:21.921765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: warnings.warn(msg) May 18 22:41:21.921765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: May 18 22:41:21.922988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87009367-eb6d-4daa-9638-76b4bca6c0ed admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.019089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 779/1559] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.020443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ebc03-3169-4127-979b-f69f5071e91c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.020725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ebc03-3169-4127-979b-f69f5071e91c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.020995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ebc03-3169-4127-979b-f69f5071e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.039754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-da5ebc03-3169-4127-979b-f69f5071e91c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:22.040955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-da5ebc03-3169-4127-979b-f69f5071e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:22.043753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 781/1560] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:21 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.045721 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4996-fa37-413a-a46b-1f20a9ae1449 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.046151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4996-fa37-413a-a46b-1f20a9ae1449 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.046635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c4996-fa37-413a-a46b-1f20a9ae1449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.065443 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4d7c4996-fa37-413a-a46b-1f20a9ae1449 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:22.066712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4d7c4996-fa37-413a-a46b-1f20a9ae1449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:22.106122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 780/1561] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:22.106966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ebc03-3169-4127-979b-f69f5071e91c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.113807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:22.115075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:22.117474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ebc03-3169-4127-979b-f69f5071e91c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.121886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.122552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.123803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.123803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.123803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:22.124189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.125782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.129254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 782/1562] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:22.130680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b35-adfb-46fc-a7aa-49735bfcb5d2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.130957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b35-adfb-46fc-a7aa-49735bfcb5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.131230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71052b35-adfb-46fc-a7aa-49735bfcb5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.144569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 781/1563] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:22.144569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.148316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5deab-a709-4e85-afc5-b6bc14348a20 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.149252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-71052b35-adfb-46fc-a7aa-49735bfcb5d2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:22.150459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-71052b35-adfb-46fc-a7aa-49735bfcb5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:22.153816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.155143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.158236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.158236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.158236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:22.158236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.158559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.158896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 783/1564] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:22.159738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052b35-adfb-46fc-a7aa-49735bfcb5d2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.171646 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 782/1565] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:22.171917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71052b35-adfb-46fc-a7aa-49735bfcb5d2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.172367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.176465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724492-1451-4467-8187-837cfaa76b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.177118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724492-1451-4467-8187-837cfaa76b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.177393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724492-1451-4467-8187-837cfaa76b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.177662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724492-1451-4467-8187-837cfaa76b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.178715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724492-1451-4467-8187-837cfaa76b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.180309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724492-1451-4467-8187-837cfaa76b76 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.181897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358d2b-8dd8-4473-ac68-34c252ea9c47 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.186546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.187205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.187603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.187761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.188445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.189451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WARNING py.warnings [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:41:22.189451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: warnings.warn(msg) May 18 22:41:22.189451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: May 18 22:41:22.190687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.194275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 784/1566] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:22.194275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724492-1451-4467-8187-837cfaa76b76 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.202446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724492-1451-4467-8187-837cfaa76b76 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.207161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d791f82-f932-4cff-ba76-aae373c364b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.207793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d791f82-f932-4cff-ba76-aae373c364b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.208065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d791f82-f932-4cff-ba76-aae373c364b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.208441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d791f82-f932-4cff-ba76-aae373c364b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.209116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d791f82-f932-4cff-ba76-aae373c364b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.211156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d791f82-f932-4cff-ba76-aae373c364b6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.263154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 783/1567] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.264007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.273336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c709726-58b8-46cd-9291-777992f109d3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.277878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.278535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.278871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.279094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.280604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:22.280917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.282526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.290725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 785/1568] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.290725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d791f82-f932-4cff-ba76-aae373c364b6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.294589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 784/1569] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:22.296093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.299670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d791f82-f932-4cff-ba76-aae373c364b6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.306031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.306683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.306957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.307262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.307974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:22.308273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.309860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.311491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178e188-bdda-4ec7-ac33-26b1b1fca21c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.316058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cdb7a-d259-459e-8376-5742da05768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.316704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cdb7a-d259-459e-8376-5742da05768d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.316989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cdb7a-d259-459e-8376-5742da05768d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.317272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cdb7a-d259-459e-8376-5742da05768d admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.317964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cdb7a-d259-459e-8376-5742da05768d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.319930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cdb7a-d259-459e-8376-5742da05768d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.322277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 786/1570] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:22.323061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.332634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd55cb-9e5b-4b37-a1ed-b866f384a095 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.337409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.338077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.338361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.338634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.339344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:22.339647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.341289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.353373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 787/1571] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:22.354283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.364518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dc65e-2a6c-4801-8d71-df8f11850422 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.369095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7a0b-f5a3-440a-a958-47c14be562d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.369708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7a0b-f5a3-440a-a958-47c14be562d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.369986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7a0b-f5a3-440a-a958-47c14be562d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.370288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c7a0b-f5a3-440a-a958-47c14be562d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.370957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c7a0b-f5a3-440a-a958-47c14be562d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.372849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c7a0b-f5a3-440a-a958-47c14be562d0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.413896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 785/1572] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.414522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cdb7a-d259-459e-8376-5742da05768d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.464465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 788/1573] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.465232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7a0b-f5a3-440a-a958-47c14be562d0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.477112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cdb7a-d259-459e-8376-5742da05768d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.530419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c7a0b-f5a3-440a-a958-47c14be562d0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.534271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078cd82-b331-477e-a1e1-d969db7a6287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.535180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cd82-b331-477e-a1e1-d969db7a6287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.535304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98808e3c-cdbd-4f9d-b0f1-8b77cdf548a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.535441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cd82-b331-477e-a1e1-d969db7a6287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.535709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cd82-b331-477e-a1e1-d969db7a6287 admin admin] PATH_INFO: `/v3/projects/c184ebb6e93a4cd58d65d8fbe43c4760/users/be51e8b84bb7471bb17409b331e599eb/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.535912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808e3c-cdbd-4f9d-b0f1-8b77cdf548a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.536194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808e3c-cdbd-4f9d-b0f1-8b77cdf548a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.536472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808e3c-cdbd-4f9d-b0f1-8b77cdf548a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.537198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98808e3c-cdbd-4f9d-b0f1-8b77cdf548a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.540148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98808e3c-cdbd-4f9d-b0f1-8b77cdf548a5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.552642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 789/1574] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:22.552642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98808e3c-cdbd-4f9d-b0f1-8b77cdf548a5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.554209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078cd82-b331-477e-a1e1-d969db7a6287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c184ebb6e93a4cd58d65d8fbe43c4760, user_id=be51e8b84bb7471bb17409b331e599eb, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.557192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078cd82-b331-477e-a1e1-d969db7a6287 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.560363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98808e3c-cdbd-4f9d-b0f1-8b77cdf548a5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.565476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37868669-ad3b-406e-a73a-b97e938b0fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.566146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37868669-ad3b-406e-a73a-b97e938b0fda admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.566447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37868669-ad3b-406e-a73a-b97e938b0fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.566715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37868669-ad3b-406e-a73a-b97e938b0fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.567453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37868669-ad3b-406e-a73a-b97e938b0fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.569036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37868669-ad3b-406e-a73a-b97e938b0fda admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.579029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 790/1575] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:22.579772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37868669-ad3b-406e-a73a-b97e938b0fda admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.588762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37868669-ad3b-406e-a73a-b97e938b0fda admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.593268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f8f45-b860-4333-a6a3-3870c33d778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.593861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8f45-b860-4333-a6a3-3870c33d778e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.594167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8f45-b860-4333-a6a3-3870c33d778e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.594452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8f45-b860-4333-a6a3-3870c33d778e admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.595094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f8f45-b860-4333-a6a3-3870c33d778e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.596924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f8f45-b860-4333-a6a3-3870c33d778e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.629990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 786/1576] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:22 2022] PUT /identity/v3/projects/c184ebb6e93a4cd58d65d8fbe43c4760/users/be51e8b84bb7471bb17409b331e599eb/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:22.630960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078cd82-b331-477e-a1e1-d969db7a6287 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.649352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:22.687834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 791/1577] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.688639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f8f45-b860-4333-a6a3-3870c33d778e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.695632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078cd82-b331-477e-a1e1-d969db7a6287 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.722780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:22.749727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f8f45-b860-4333-a6a3-3870c33d778e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.753556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb23b-a906-43ed-aaf3-7b84de3c957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.754244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb23b-a906-43ed-aaf3-7b84de3c957f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.754379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4652-c991-43e5-a7d2-4f3864c59a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.754534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb23b-a906-43ed-aaf3-7b84de3c957f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.754805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aeb23b-a906-43ed-aaf3-7b84de3c957f admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.754952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4652-c991-43e5-a7d2-4f3864c59a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.755231 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4652-c991-43e5-a7d2-4f3864c59a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.755492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb23b-a906-43ed-aaf3-7b84de3c957f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.755601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e4652-c991-43e5-a7d2-4f3864c59a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.756160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e4652-c991-43e5-a7d2-4f3864c59a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.757385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aeb23b-a906-43ed-aaf3-7b84de3c957f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.758061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e4652-c991-43e5-a7d2-4f3864c59a2f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.819028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 787/1578] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.820111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb23b-a906-43ed-aaf3-7b84de3c957f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.845805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 792/1579] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:22.845805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4652-c991-43e5-a7d2-4f3864c59a2f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:22.884707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aeb23b-a906-43ed-aaf3-7b84de3c957f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.910682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e4652-c991-43e5-a7d2-4f3864c59a2f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:22.915941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b201a-d04e-43cd-a4c5-b6bf2be0df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.916720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b201a-d04e-43cd-a4c5-b6bf2be0df26 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.917213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b201a-d04e-43cd-a4c5-b6bf2be0df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.917315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b201a-d04e-43cd-a4c5-b6bf2be0df26 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.918025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b201a-d04e-43cd-a4c5-b6bf2be0df26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.920015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b201a-d04e-43cd-a4c5-b6bf2be0df26 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:22.934410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:22.942383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ac01c-e7bc-489e-af71-936ad11fdeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:22.943054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac01c-e7bc-489e-af71-936ad11fdeac admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:22.943336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac01c-e7bc-489e-af71-936ad11fdeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:22.943609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ac01c-e7bc-489e-af71-936ad11fdeac admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:22.944301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ac01c-e7bc-489e-af71-936ad11fdeac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:22.946239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ac01c-e7bc-489e-af71-936ad11fdeac admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.028679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 793/1580] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:23.029963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b201a-d04e-43cd-a4c5-b6bf2be0df26 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.039262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b201a-d04e-43cd-a4c5-b6bf2be0df26 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.043901 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68414800-ba55-4231-9abe-efeb40ebaf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.044587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414800-ba55-4231-9abe-efeb40ebaf50 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.045495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414800-ba55-4231-9abe-efeb40ebaf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.045777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68414800-ba55-4231-9abe-efeb40ebaf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.046532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68414800-ba55-4231-9abe-efeb40ebaf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.048126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68414800-ba55-4231-9abe-efeb40ebaf50 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.059882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 794/1581] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.060765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68414800-ba55-4231-9abe-efeb40ebaf50 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.065692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 788/1582] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:22 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:23.065692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae3875-f34b-48fc-8f60-86b3b8b36912 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.065692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae3875-f34b-48fc-8f60-86b3b8b36912 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.065692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae3875-f34b-48fc-8f60-86b3b8b36912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.070857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68414800-ba55-4231-9abe-efeb40ebaf50 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.075466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa809-c2fe-436c-87ed-7653eb67b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.076130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa809-c2fe-436c-87ed-7653eb67b7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.076424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa809-c2fe-436c-87ed-7653eb67b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.076696 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300aa809-c2fe-436c-87ed-7653eb67b7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.077432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa809-c2fe-436c-87ed-7653eb67b7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.079077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300aa809-c2fe-436c-87ed-7653eb67b7ba admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.082276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-68ae3875-f34b-48fc-8f60-86b3b8b36912 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:23.083482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-68ae3875-f34b-48fc-8f60-86b3b8b36912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:23.092843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 795/1583] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.092843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa809-c2fe-436c-87ed-7653eb67b7ba admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.093238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 789/1584] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:23.093238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae3875-f34b-48fc-8f60-86b3b8b36912 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.100691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300aa809-c2fe-436c-87ed-7653eb67b7ba admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.105478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b71b-07b8-4b65-aa60-41b15c1b9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.105833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae3875-f34b-48fc-8f60-86b3b8b36912 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.106162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b71b-07b8-4b65-aa60-41b15c1b9a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.106440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b71b-07b8-4b65-aa60-41b15c1b9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.106707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b71b-07b8-4b65-aa60-41b15c1b9a3b admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.108081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133b71b-07b8-4b65-aa60-41b15c1b9a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.109989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133b71b-07b8-4b65-aa60-41b15c1b9a3b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.111561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f0117-ef0a-4910-9408-3af4f7c11710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.112217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0117-ef0a-4910-9408-3af4f7c11710 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.112499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0117-ef0a-4910-9408-3af4f7c11710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.112772 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0117-ef0a-4910-9408-3af4f7c11710 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.113450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f0117-ef0a-4910-9408-3af4f7c11710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.115410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f0117-ef0a-4910-9408-3af4f7c11710 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.236509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 790/1585] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:23 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:23.237496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f0117-ef0a-4910-9408-3af4f7c11710 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.247856 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f0117-ef0a-4910-9408-3af4f7c11710 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.253695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53438549-93cd-4ceb-9698-f4941b23ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.255119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53438549-93cd-4ceb-9698-f4941b23ae44 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.255119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53438549-93cd-4ceb-9698-f4941b23ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.255119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53438549-93cd-4ceb-9698-f4941b23ae44 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.255716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53438549-93cd-4ceb-9698-f4941b23ae44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.257676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53438549-93cd-4ceb-9698-f4941b23ae44 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.338466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 791/1586] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:23 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:23.339230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53438549-93cd-4ceb-9698-f4941b23ae44 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.349758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53438549-93cd-4ceb-9698-f4941b23ae44 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.354389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffb6b6-a017-4198-a939-89f71cc56b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.355046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffb6b6-a017-4198-a939-89f71cc56b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.355323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffb6b6-a017-4198-a939-89f71cc56b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.355593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffb6b6-a017-4198-a939-89f71cc56b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.355773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 796/1587] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:23 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:23.356315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffb6b6-a017-4198-a939-89f71cc56b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.356645 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b71b-07b8-4b65-aa60-41b15c1b9a3b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.357930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ffb6b6-a017-4198-a939-89f71cc56b37 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.368466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b71b-07b8-4b65-aa60-41b15c1b9a3b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.373164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 792/1588] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.373164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffb6b6-a017-4198-a939-89f71cc56b37 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.375916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.376785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.377055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.377316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] PATH_INFO: `/v3/projects/f60b6521267447fe8b4c12f701a40144/users/270785984bc645ec899aeb22a8f9054f/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.382679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffb6b6-a017-4198-a939-89f71cc56b37 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.387150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198b541-32f3-4cba-89e7-2bb930c1137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.387785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b541-32f3-4cba-89e7-2bb930c1137e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.388064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b541-32f3-4cba-89e7-2bb930c1137e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.388333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b541-32f3-4cba-89e7-2bb930c1137e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.389603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b541-32f3-4cba-89e7-2bb930c1137e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.391281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b541-32f3-4cba-89e7-2bb930c1137e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.392932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60b6521267447fe8b4c12f701a40144, user_id=270785984bc645ec899aeb22a8f9054f, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.394457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING py.warnings [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:41:23.394457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: warnings.warn(msg) May 18 22:41:23.394457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: May 18 22:41:23.396781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.401814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 793/1589] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.402447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198b541-32f3-4cba-89e7-2bb930c1137e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.412468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198b541-32f3-4cba-89e7-2bb930c1137e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.416937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced202b-7e9b-4d69-b471-013bb2b58a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.417773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced202b-7e9b-4d69-b471-013bb2b58a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.418082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced202b-7e9b-4d69-b471-013bb2b58a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.418355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced202b-7e9b-4d69-b471-013bb2b58a77 admin admin] PATH_INFO: `/v3/projects/9b05185695df49178ee95aa260a5b42f/users/fc88352e51be4df694d71a24b897c393/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.433104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced202b-7e9b-4d69-b471-013bb2b58a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b05185695df49178ee95aa260a5b42f, user_id=fc88352e51be4df694d71a24b897c393, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.435764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced202b-7e9b-4d69-b471-013bb2b58a77 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.463003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 797/1590] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:23 2022] PUT /identity/v3/projects/f60b6521267447fe8b4c12f701a40144/users/270785984bc645ec899aeb22a8f9054f/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:23.463820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.506898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:23.517332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f7427-706c-424d-9170-43e5a6adc856 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.521096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6a552-8e66-4138-8b69-dc2201f7554f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.521725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a552-8e66-4138-8b69-dc2201f7554f service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.522029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a552-8e66-4138-8b69-dc2201f7554f service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.522300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6a552-8e66-4138-8b69-dc2201f7554f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.537462 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 794/1591] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:23 2022] PUT /identity/v3/projects/9b05185695df49178ee95aa260a5b42f/users/fc88352e51be4df694d71a24b897c393/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:23.538473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced202b-7e9b-4d69-b471-013bb2b58a77 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.594834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6a552-8e66-4138-8b69-dc2201f7554f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.596240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6a552-8e66-4138-8b69-dc2201f7554f service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.600984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced202b-7e9b-4d69-b471-013bb2b58a77 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.605597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 798/1592] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:23.605749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1dd54-ccff-402d-9ae2-0721910bb099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.606605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1dd54-ccff-402d-9ae2-0721910bb099 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.606888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1dd54-ccff-402d-9ae2-0721910bb099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.607145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6a552-8e66-4138-8b69-dc2201f7554f service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.607258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1dd54-ccff-402d-9ae2-0721910bb099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.608158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1dd54-ccff-402d-9ae2-0721910bb099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.609658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1dd54-ccff-402d-9ae2-0721910bb099 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.618204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6a552-8e66-4138-8b69-dc2201f7554f service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.620921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 795/1593] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.621858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1dd54-ccff-402d-9ae2-0721910bb099 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.626738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09242bcc-d737-4ce2-9dd2-1f4c64e95dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.627446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09242bcc-d737-4ce2-9dd2-1f4c64e95dba admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.627738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09242bcc-d737-4ce2-9dd2-1f4c64e95dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.627992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09242bcc-d737-4ce2-9dd2-1f4c64e95dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.628724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09242bcc-d737-4ce2-9dd2-1f4c64e95dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.630337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09242bcc-d737-4ce2-9dd2-1f4c64e95dba admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.632245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1dd54-ccff-402d-9ae2-0721910bb099 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.637209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28266-2b52-439e-a1ff-ca8d11d892c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.637867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28266-2b52-439e-a1ff-ca8d11d892c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.638186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28266-2b52-439e-a1ff-ca8d11d892c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.638467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db28266-2b52-439e-a1ff-ca8d11d892c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.639856 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28266-2b52-439e-a1ff-ca8d11d892c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.641413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db28266-2b52-439e-a1ff-ca8d11d892c9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.643982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 799/1594] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.644805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09242bcc-d737-4ce2-9dd2-1f4c64e95dba admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.654702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 796/1595] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.654702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28266-2b52-439e-a1ff-ca8d11d892c9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.657556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09242bcc-d737-4ce2-9dd2-1f4c64e95dba admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.662198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f9813-76dd-45f3-a388-58f3d785da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.662734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db28266-2b52-439e-a1ff-ca8d11d892c9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.662864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9813-76dd-45f3-a388-58f3d785da65 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.663102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9813-76dd-45f3-a388-58f3d785da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.663392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f9813-76dd-45f3-a388-58f3d785da65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.664151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9813-76dd-45f3-a388-58f3d785da65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.665733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f9813-76dd-45f3-a388-58f3d785da65 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.667328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a9d0b-f418-42b1-b1ef-dcba0d8ca4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.667924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a9d0b-f418-42b1-b1ef-dcba0d8ca4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.668202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a9d0b-f418-42b1-b1ef-dcba0d8ca4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.668473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a9d0b-f418-42b1-b1ef-dcba0d8ca4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.669191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a9d0b-f418-42b1-b1ef-dcba0d8ca4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.670997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a9d0b-f418-42b1-b1ef-dcba0d8ca4c5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.675850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 800/1596] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.677054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c4a-345b-4307-b495-8e51f90f3627 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.677332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c4a-345b-4307-b495-8e51f90f3627 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.685101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c4a-345b-4307-b495-8e51f90f3627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.685228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 797/1597] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.685228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a6f78-5e11-4682-9de5-ddc8cf1f2065 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.685228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a6f78-5e11-4682-9de5-ddc8cf1f2065 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.685228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a6f78-5e11-4682-9de5-ddc8cf1f2065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.695404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-94118c4a-345b-4307-b495-8e51f90f3627 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:23.696637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-94118c4a-345b-4307-b495-8e51f90f3627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:23.705592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 801/1598] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:23.706392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118c4a-345b-4307-b495-8e51f90f3627 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.712062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cd3a6f78-5e11-4682-9de5-ddc8cf1f2065 None None] MFA Rules not processed for user `fc88352e51be4df694d71a24b897c393`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:23.718891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cd3a6f78-5e11-4682-9de5-ddc8cf1f2065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:23.719234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118c4a-345b-4307-b495-8e51f90f3627 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.723477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa121-c447-46a9-bb6b-5502b822b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.724225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa121-c447-46a9-bb6b-5502b822b821 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.724551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa121-c447-46a9-bb6b-5502b822b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.724823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa121-c447-46a9-bb6b-5502b822b821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.725551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aa121-c447-46a9-bb6b-5502b822b821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.727501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632aa121-c447-46a9-bb6b-5502b822b821 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.734185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:23.739914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 802/1599] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.741505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa121-c447-46a9-bb6b-5502b822b821 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.755084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa121-c447-46a9-bb6b-5502b822b821 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.761128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bf97c-5b61-4cd9-9d31-2d3d414bd1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.761796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf97c-5b61-4cd9-9d31-2d3d414bd1be admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.762253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf97c-5b61-4cd9-9d31-2d3d414bd1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.762536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bf97c-5b61-4cd9-9d31-2d3d414bd1be admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.763323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bf97c-5b61-4cd9-9d31-2d3d414bd1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.765727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bf97c-5b61-4cd9-9d31-2d3d414bd1be admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.776247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 803/1600] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.777133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bf97c-5b61-4cd9-9d31-2d3d414bd1be admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.788865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 798/1601] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:23.790687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a6f78-5e11-4682-9de5-ddc8cf1f2065 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.791199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bf97c-5b61-4cd9-9d31-2d3d414bd1be admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.796499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358f268-f6d1-4799-b550-907e10ba1c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.797162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358f268-f6d1-4799-b550-907e10ba1c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.797441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358f268-f6d1-4799-b550-907e10ba1c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.797709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358f268-f6d1-4799-b550-907e10ba1c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.798985 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358f268-f6d1-4799-b550-907e10ba1c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.800238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358f268-f6d1-4799-b550-907e10ba1c21 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.809637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a6f78-5e11-4682-9de5-ddc8cf1f2065 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.812623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 804/1602] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:23.813504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358f268-f6d1-4799-b550-907e10ba1c21 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.815545 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1174-7cfe-48f1-b613-85123cc834f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.816442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1174-7cfe-48f1-b613-85123cc834f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.816720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1174-7cfe-48f1-b613-85123cc834f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.816993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc1174-7cfe-48f1-b613-85123cc834f8 admin admin] PATH_INFO: `/v3/projects/6422f1b1118143e4b8ef54927212ca97/users/f2b45df9a7cd466593d5c8a4f30bde53/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.823474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358f268-f6d1-4799-b550-907e10ba1c21 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:23.828367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c333e5a-8447-44fa-8088-db79ab6e5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:23.829301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c333e5a-8447-44fa-8088-db79ab6e5f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:23.829582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c333e5a-8447-44fa-8088-db79ab6e5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:23.829859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c333e5a-8447-44fa-8088-db79ab6e5f84 admin admin] PATH_INFO: `/v3/projects/3469a2ead69c44788bf29197caaedd4e/users/eadfa254989a4950a50c1dff5abc874e/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:23.833524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc1174-7cfe-48f1-b613-85123cc834f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6422f1b1118143e4b8ef54927212ca97, user_id=f2b45df9a7cd466593d5c8a4f30bde53, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.836239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc1174-7cfe-48f1-b613-85123cc834f8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.845400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c333e5a-8447-44fa-8088-db79ab6e5f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3469a2ead69c44788bf29197caaedd4e, user_id=eadfa254989a4950a50c1dff5abc874e, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:23.848052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c333e5a-8447-44fa-8088-db79ab6e5f84 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:23.886169 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 799/1603] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:23 2022] PUT /identity/v3/projects/6422f1b1118143e4b8ef54927212ca97/users/f2b45df9a7cd466593d5c8a4f30bde53/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:23.887002 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1174-7cfe-48f1-b613-85123cc834f8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.930258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 805/1604] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:23 2022] PUT /identity/v3/projects/3469a2ead69c44788bf29197caaedd4e/users/eadfa254989a4950a50c1dff5abc874e/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:23.930258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c333e5a-8447-44fa-8088-db79ab6e5f84 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:23.963023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc1174-7cfe-48f1-b613-85123cc834f8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.000325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c333e5a-8447-44fa-8088-db79ab6e5f84 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.005445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412834e2-c606-434f-9386-d6db62a734be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.006516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412834e2-c606-434f-9386-d6db62a734be admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.006793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412834e2-c606-434f-9386-d6db62a734be admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.007065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412834e2-c606-434f-9386-d6db62a734be admin admin] PATH_INFO: `/v3/projects/8bf9ae3e5a5641be99023d5899ce228c/users/ab2882c84e454d5789f5c76f49998525/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.018122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a45ef3-0746-4a8b-8dcc-c772aea2cf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.018765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a45ef3-0746-4a8b-8dcc-c772aea2cf1b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.019045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a45ef3-0746-4a8b-8dcc-c772aea2cf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.019319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a45ef3-0746-4a8b-8dcc-c772aea2cf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.019476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.023384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412834e2-c606-434f-9386-d6db62a734be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9ae3e5a5641be99023d5899ce228c, user_id=ab2882c84e454d5789f5c76f49998525, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.026261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412834e2-c606-434f-9386-d6db62a734be admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.030318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a45ef3-0746-4a8b-8dcc-c772aea2cf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.031024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a45ef3-0746-4a8b-8dcc-c772aea2cf1b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.042337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 800/1605] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:24.042715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a45ef3-0746-4a8b-8dcc-c772aea2cf1b service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.052188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a45ef3-0746-4a8b-8dcc-c772aea2cf1b service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.057183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2349fd-73e2-4a24-9591-13cdb5b208c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.059547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2349fd-73e2-4a24-9591-13cdb5b208c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.059547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2349fd-73e2-4a24-9591-13cdb5b208c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.059547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2349fd-73e2-4a24-9591-13cdb5b208c4 admin admin] PATH_INFO: `/v3/projects/f8bbc83e1a8e4aaab9f728bdfd58412f/users/a9cf8e07eee644de8b6da0d1bd6969db/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.075160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2349fd-73e2-4a24-9591-13cdb5b208c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8bbc83e1a8e4aaab9f728bdfd58412f, user_id=a9cf8e07eee644de8b6da0d1bd6969db, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.078904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2349fd-73e2-4a24-9591-13cdb5b208c4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.092909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 806/1606] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:23 2022] PUT /identity/v3/projects/8bf9ae3e5a5641be99023d5899ce228c/users/ab2882c84e454d5789f5c76f49998525/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:24.093924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412834e2-c606-434f-9386-d6db62a734be admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.163282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412834e2-c606-434f-9386-d6db62a734be admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.169955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 801/1607] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:24 2022] PUT /identity/v3/projects/f8bbc83e1a8e4aaab9f728bdfd58412f/users/a9cf8e07eee644de8b6da0d1bd6969db/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:24.169955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2349fd-73e2-4a24-9591-13cdb5b208c4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.223476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.264239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1ac31-0922-4b86-904f-28d77f32e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.265349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1ac31-0922-4b86-904f-28d77f32e021 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.265535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1ac31-0922-4b86-904f-28d77f32e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.265760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1ac31-0922-4b86-904f-28d77f32e021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.266884 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1ac31-0922-4b86-904f-28d77f32e021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.268596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1ac31-0922-4b86-904f-28d77f32e021 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.271249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2349fd-73e2-4a24-9591-13cdb5b208c4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.277578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b650c-e721-4fb6-82a7-6e38ee72ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.278152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b650c-e721-4fb6-82a7-6e38ee72ba21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.281325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b650c-e721-4fb6-82a7-6e38ee72ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.281325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b650c-e721-4fb6-82a7-6e38ee72ba21 admin admin] PATH_INFO: `/v3/projects/baa1d5dbae03406b9dc8f5932ec1bcbc/users/2a49cfb501a24446ba4b1717bb1cafbc/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.295252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b650c-e721-4fb6-82a7-6e38ee72ba21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa1d5dbae03406b9dc8f5932ec1bcbc, user_id=2a49cfb501a24446ba4b1717bb1cafbc, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.297970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b650c-e721-4fb6-82a7-6e38ee72ba21 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.353825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 807/1608] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:24.353825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5637-f4a8-49ae-9283-0c565401b647 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.353825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5637-f4a8-49ae-9283-0c565401b647 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.353825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e5637-f4a8-49ae-9283-0c565401b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.372470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c93e5637-f4a8-49ae-9283-0c565401b647 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:24.374785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c93e5637-f4a8-49ae-9283-0c565401b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:24.384934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 802/1609] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:24 2022] PUT /identity/v3/projects/baa1d5dbae03406b9dc8f5932ec1bcbc/users/2a49cfb501a24446ba4b1717bb1cafbc/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:24.384934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6423ff-a8b1-4dd8-936c-660f83baeeb2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.384934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6423ff-a8b1-4dd8-936c-660f83baeeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.384934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6423ff-a8b1-4dd8-936c-660f83baeeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.417536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6c6423ff-a8b1-4dd8-936c-660f83baeeb2 None None] MFA Rules not processed for user `eadfa254989a4950a50c1dff5abc874e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:24.419038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6c6423ff-a8b1-4dd8-936c-660f83baeeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:24.443134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 808/1610] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:24.444597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045161c0-24ab-4f0d-ab0f-f073519c9366 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.445034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045161c0-24ab-4f0d-ab0f-f073519c9366 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.445437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045161c0-24ab-4f0d-ab0f-f073519c9366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.480196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-045161c0-24ab-4f0d-ab0f-f073519c9366 None None] MFA Rules not processed for user `ab2882c84e454d5789f5c76f49998525`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:24.481270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-045161c0-24ab-4f0d-ab0f-f073519c9366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:24.501705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 803/1611] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:24.502882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728fe20-56c0-43ea-9cc7-b47b83292fb7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.503178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728fe20-56c0-43ea-9cc7-b47b83292fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.503428 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728fe20-56c0-43ea-9cc7-b47b83292fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.513016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.536011 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d728fe20-56c0-43ea-9cc7-b47b83292fb7 None None] MFA Rules not processed for user `a9cf8e07eee644de8b6da0d1bd6969db`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:24.537410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d728fe20-56c0-43ea-9cc7-b47b83292fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:24.587444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 809/1612] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:24.588761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045161c0-24ab-4f0d-ab0f-f073519c9366 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.600830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045161c0-24ab-4f0d-ab0f-f073519c9366 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.606939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4afdc2-b6e4-4b31-9c13-df1ba23ac10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.607637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4afdc2-b6e4-4b31-9c13-df1ba23ac10d admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.607921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4afdc2-b6e4-4b31-9c13-df1ba23ac10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.608190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4afdc2-b6e4-4b31-9c13-df1ba23ac10d admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.609520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4afdc2-b6e4-4b31-9c13-df1ba23ac10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.610098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 804/1613] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:24.611193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bfe47-1dd3-4274-9596-6da2d6cf1d4a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.611474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bfe47-1dd3-4274-9596-6da2d6cf1d4a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.611743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bfe47-1dd3-4274-9596-6da2d6cf1d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.621809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4afdc2-b6e4-4b31-9c13-df1ba23ac10d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.642578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f22bfe47-1dd3-4274-9596-6da2d6cf1d4a None None] MFA Rules not processed for user `2a49cfb501a24446ba4b1717bb1cafbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:24.643892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f22bfe47-1dd3-4274-9596-6da2d6cf1d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:24.666398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.712545 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 805/1614] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:24.713834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bfe47-1dd3-4274-9596-6da2d6cf1d4a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.756441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 810/1615] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:24.759214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3643-73e9-4869-9d6d-74f0a273fdc2 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.760090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3643-73e9-4869-9d6d-74f0a273fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.761653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3643-73e9-4869-9d6d-74f0a273fdc2 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.771703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 811/1616] 10.222.0.70 () {54 vars in 961 bytes} [Wed May 18 22:41:24 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:41:24.772914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3643-73e9-4869-9d6d-74f0a273fdc2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.784918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bfe47-1dd3-4274-9596-6da2d6cf1d4a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.790767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6024c-c7f9-4b15-b035-9cf9086ece35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.791449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3643-73e9-4869-9d6d-74f0a273fdc2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.791627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6024c-c7f9-4b15-b035-9cf9086ece35 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.791915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6024c-c7f9-4b15-b035-9cf9086ece35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.792365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6024c-c7f9-4b15-b035-9cf9086ece35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.797898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5b3cd-21c8-4fc9-a88b-46e90856d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.798656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b3cd-21c8-4fc9-a88b-46e90856d036 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.799026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b3cd-21c8-4fc9-a88b-46e90856d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.799488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5b3cd-21c8-4fc9-a88b-46e90856d036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.800246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5b3cd-21c8-4fc9-a88b-46e90856d036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.802287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5b3cd-21c8-4fc9-a88b-46e90856d036 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.804875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6024c-c7f9-4b15-b035-9cf9086ece35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.808337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6024c-c7f9-4b15-b035-9cf9086ece35 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.821928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 806/1617] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:24.824059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6024c-c7f9-4b15-b035-9cf9086ece35 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.877910 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6024c-c7f9-4b15-b035-9cf9086ece35 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.881596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42b949-13ab-45bd-86be-cbc84e54ae47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.882273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42b949-13ab-45bd-86be-cbc84e54ae47 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.882557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42b949-13ab-45bd-86be-cbc84e54ae47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.882837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42b949-13ab-45bd-86be-cbc84e54ae47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.891438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42b949-13ab-45bd-86be-cbc84e54ae47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.897789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42b949-13ab-45bd-86be-cbc84e54ae47 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.901896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 807/1618] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:24.902734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42b949-13ab-45bd-86be-cbc84e54ae47 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.912827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42b949-13ab-45bd-86be-cbc84e54ae47 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:24.926221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 812/1619] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:24.926221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6dc9-5f17-41ac-806f-53039f0bbefb None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.926221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6dc9-5f17-41ac-806f-53039f0bbefb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.926221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6dc9-5f17-41ac-806f-53039f0bbefb None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.931632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 813/1620] 10.222.0.70 () {54 vars in 961 bytes} [Wed May 18 22:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:41:24.932957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5058737-d613-4ab4-9988-3c9af627db75 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.933356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5058737-d613-4ab4-9988-3c9af627db75 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.933533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5058737-d613-4ab4-9988-3c9af627db75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.939085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5f4c5-cd48-4ba6-8cc8-45ae75617063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:24.939765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f4c5-cd48-4ba6-8cc8-45ae75617063 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:24.940049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f4c5-cd48-4ba6-8cc8-45ae75617063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:24.940330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5f4c5-cd48-4ba6-8cc8-45ae75617063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:24.941062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5f4c5-cd48-4ba6-8cc8-45ae75617063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:24.943394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5f4c5-cd48-4ba6-8cc8-45ae75617063 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:24.960006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 808/1621] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:24.960881 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5f4c5-cd48-4ba6-8cc8-45ae75617063 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:24.970354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c5058737-d613-4ab4-9988-3c9af627db75 None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:24.971888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c5058737-d613-4ab4-9988-3c9af627db75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:24.978531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5f4c5-cd48-4ba6-8cc8-45ae75617063 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.065185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f6ab0-96ca-4dea-9f4f-724c56f4637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.066582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f6ab0-96ca-4dea-9f4f-724c56f4637d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.067313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f6ab0-96ca-4dea-9f4f-724c56f4637d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.067600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f6ab0-96ca-4dea-9f4f-724c56f4637d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.068316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f6ab0-96ca-4dea-9f4f-724c56f4637d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:25.072294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f6ab0-96ca-4dea-9f4f-724c56f4637d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:25.104577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 814/1622] 10.222.0.70 () {58 vars in 1058 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:25.121272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462d6c5-0b99-4917-b3e5-60b112935f9e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.124494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462d6c5-0b99-4917-b3e5-60b112935f9e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.124494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462d6c5-0b99-4917-b3e5-60b112935f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.146585 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5462d6c5-0b99-4917-b3e5-60b112935f9e None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:25.153011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5462d6c5-0b99-4917-b3e5-60b112935f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:25.161849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 815/1623] 10.222.0.70 () {58 vars in 1058 bytes} [Wed May 18 22:41:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:25.162797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462d6c5-0b99-4917-b3e5-60b112935f9e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:25.175178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462d6c5-0b99-4917-b3e5-60b112935f9e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.184745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4a26d-4412-44f5-9c7b-35e0ee2c4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.184745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4a26d-4412-44f5-9c7b-35e0ee2c4b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.184745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4a26d-4412-44f5-9c7b-35e0ee2c4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.184745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4a26d-4412-44f5-9c7b-35e0ee2c4b89 admin admin] PATH_INFO: `/v3/projects/5f8675227c134334bf6fd0f1db91da98/users/ace3bb4d994b4d8a9385a2269c3b41a0/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.199325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4a26d-4412-44f5-9c7b-35e0ee2c4b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8675227c134334bf6fd0f1db91da98, user_id=ace3bb4d994b4d8a9385a2269c3b41a0, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:25.202581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4a26d-4412-44f5-9c7b-35e0ee2c4b89 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:25.215827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 809/1624] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:24 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:25.215827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f6ab0-96ca-4dea-9f4f-724c56f4637d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:25.231183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f6ab0-96ca-4dea-9f4f-724c56f4637d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.240144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d02781-d050-4b6c-9c33-4dfb3114ccf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.241280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d02781-d050-4b6c-9c33-4dfb3114ccf7 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.241804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d02781-d050-4b6c-9c33-4dfb3114ccf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.242251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d02781-d050-4b6c-9c33-4dfb3114ccf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.316966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 816/1625] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:25 2022] PUT /identity/v3/projects/5f8675227c134334bf6fd0f1db91da98/users/ace3bb4d994b4d8a9385a2269c3b41a0/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:25.318288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4a26d-4412-44f5-9c7b-35e0ee2c4b89 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:25.323165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d02781-d050-4b6c-9c33-4dfb3114ccf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:25.324956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d02781-d050-4b6c-9c33-4dfb3114ccf7 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:25.339353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 810/1626] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:25.340790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d02781-d050-4b6c-9c33-4dfb3114ccf7 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:25.355956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d02781-d050-4b6c-9c33-4dfb3114ccf7 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.402329 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:25.432352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e0aff-63b8-45d9-907b-3858725d3f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.434147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e0aff-63b8-45d9-907b-3858725d3f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.434147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e0aff-63b8-45d9-907b-3858725d3f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.434375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e0aff-63b8-45d9-907b-3858725d3f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.435284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e0aff-63b8-45d9-907b-3858725d3f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:25.437430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e0aff-63b8-45d9-907b-3858725d3f31 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:25.464940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 811/1627] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:25.465889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e0aff-63b8-45d9-907b-3858725d3f31 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:25.492154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4a26d-4412-44f5-9c7b-35e0ee2c4b89 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.493590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e0aff-63b8-45d9-907b-3858725d3f31 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.502413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9d1f-8001-4d47-b0e8-4c55a6d1ce9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.505605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9d1f-8001-4d47-b0e8-4c55a6d1ce9f service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.505605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9d1f-8001-4d47-b0e8-4c55a6d1ce9f service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.505605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9d1f-8001-4d47-b0e8-4c55a6d1ce9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.506313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b640-6639-4bd2-b7ce-b2f65f59e780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.506313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b640-6639-4bd2-b7ce-b2f65f59e780 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.506313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b640-6639-4bd2-b7ce-b2f65f59e780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.506313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b640-6639-4bd2-b7ce-b2f65f59e780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.508987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b640-6639-4bd2-b7ce-b2f65f59e780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:25.510664 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b640-6639-4bd2-b7ce-b2f65f59e780 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:25.565503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 812/1628] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:25.565503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b640-6639-4bd2-b7ce-b2f65f59e780 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:25.592860 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b640-6639-4bd2-b7ce-b2f65f59e780 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.609310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f55fb-e9b8-4d49-8c80-9ab71eb947ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.610241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f55fb-e9b8-4d49-8c80-9ab71eb947ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.610520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f55fb-e9b8-4d49-8c80-9ab71eb947ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.610790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f55fb-e9b8-4d49-8c80-9ab71eb947ae admin admin] PATH_INFO: `/v3/projects/91e5dec2a9514844aac1d6276d3b0a6e/users/b5fa40d875e04becb472e743935fb80f/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.616809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c9d1f-8001-4d47-b0e8-4c55a6d1ce9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:25.618574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c9d1f-8001-4d47-b0e8-4c55a6d1ce9f service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:25.634793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 817/1629] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:25.635659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9d1f-8001-4d47-b0e8-4c55a6d1ce9f service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:25.672931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f55fb-e9b8-4d49-8c80-9ab71eb947ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e5dec2a9514844aac1d6276d3b0a6e, user_id=b5fa40d875e04becb472e743935fb80f, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:25.680035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9d1f-8001-4d47-b0e8-4c55a6d1ce9f service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.681479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f55fb-e9b8-4d49-8c80-9ab71eb947ae admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:25.701272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b102-51cc-4a57-bda2-d02bf345ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.703659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b102-51cc-4a57-bda2-d02bf345ab4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.706134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b102-51cc-4a57-bda2-d02bf345ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.706451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b102-51cc-4a57-bda2-d02bf345ab4c admin admin] PATH_INFO: `/v3/projects/5f8675227c134334bf6fd0f1db91da98/users/ace3bb4d994b4d8a9385a2269c3b41a0/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.713186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241b102-51cc-4a57-bda2-d02bf345ab4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8675227c134334bf6fd0f1db91da98, user_id=ace3bb4d994b4d8a9385a2269c3b41a0, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:25.723220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241b102-51cc-4a57-bda2-d02bf345ab4c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:25.784399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 818/1630] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:25 2022] PUT /identity/v3/projects/5f8675227c134334bf6fd0f1db91da98/users/ace3bb4d994b4d8a9385a2269c3b41a0/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:25.790939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 813/1631] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:25 2022] PUT /identity/v3/projects/91e5dec2a9514844aac1d6276d3b0a6e/users/b5fa40d875e04becb472e743935fb80f/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:25.792766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d704-dd94-4d78-adb1-243e76cbc712 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.793142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d704-dd94-4d78-adb1-243e76cbc712 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:25.794520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f55fb-e9b8-4d49-8c80-9ab71eb947ae admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:25.795605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179d704-dd94-4d78-adb1-243e76cbc712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:25.897520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1179d704-dd94-4d78-adb1-243e76cbc712 None None] MFA Rules not processed for user `ace3bb4d994b4d8a9385a2269c3b41a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:25.899581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1179d704-dd94-4d78-adb1-243e76cbc712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:25.985962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:25.994044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f55fb-e9b8-4d49-8c80-9ab71eb947ae admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:25.997303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec81580-7f94-45c6-a825-0d0284134ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:25.999082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81580-7f94-45c6-a825-0d0284134ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:25.999982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81580-7f94-45c6-a825-0d0284134ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.000627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81580-7f94-45c6-a825-0d0284134ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.001343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec81580-7f94-45c6-a825-0d0284134ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:26.003996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec81580-7f94-45c6-a825-0d0284134ed5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:26.023404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 814/1632] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:26.023404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57a74d-1784-4963-9126-8b59eaf18bcc None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.026932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57a74d-1784-4963-9126-8b59eaf18bcc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.026932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57a74d-1784-4963-9126-8b59eaf18bcc None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.026932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 815/1633] 10.222.0.70 () {54 vars in 912 bytes} [Wed May 18 22:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:41:26.032080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64d51-aa6c-4fea-8cae-326292700bf2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.032399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64d51-aa6c-4fea-8cae-326292700bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.032681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e64d51-aa6c-4fea-8cae-326292700bf2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.034224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 816/1634] 10.222.0.70 () {54 vars in 912 bytes} [Wed May 18 22:41:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:41:26.035031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64d51-aa6c-4fea-8cae-326292700bf2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:26.050732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 819/1635] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:26.051552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12857-da32-4dbb-bd5d-ccb87f8045b8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.058753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12857-da32-4dbb-bd5d-ccb87f8045b8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.058753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12857-da32-4dbb-bd5d-ccb87f8045b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.073309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e64d51-aa6c-4fea-8cae-326292700bf2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:26.080914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d3257-a36b-4729-8a83-a8d72be28a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:26.081815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3257-a36b-4729-8a83-a8d72be28a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.082195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3257-a36b-4729-8a83-a8d72be28a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.082493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3257-a36b-4729-8a83-a8d72be28a31 admin admin] PATH_INFO: `/v3/projects/91e5dec2a9514844aac1d6276d3b0a6e/users/b5fa40d875e04becb472e743935fb80f/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.084519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d3257-a36b-4729-8a83-a8d72be28a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e5dec2a9514844aac1d6276d3b0a6e, user_id=b5fa40d875e04becb472e743935fb80f, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:26.087473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d3257-a36b-4729-8a83-a8d72be28a31 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:26.090749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7cd12857-da32-4dbb-bd5d-ccb87f8045b8 None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:26.095343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7cd12857-da32-4dbb-bd5d-ccb87f8045b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:26.099284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 817/1636] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:26 2022] PUT /identity/v3/projects/91e5dec2a9514844aac1d6276d3b0a6e/users/b5fa40d875e04becb472e743935fb80f/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:26.100663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69841f1c-18e7-47b0-ae0a-5f6c99e3442e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.100949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69841f1c-18e7-47b0-ae0a-5f6c99e3442e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.101226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69841f1c-18e7-47b0-ae0a-5f6c99e3442e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.156903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-69841f1c-18e7-47b0-ae0a-5f6c99e3442e None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:26.172354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-69841f1c-18e7-47b0-ae0a-5f6c99e3442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:26.189323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 820/1637] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:41:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:26.191299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96466-378b-41e4-9837-2c34089d6f45 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.191671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96466-378b-41e4-9837-2c34089d6f45 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.192176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f96466-378b-41e4-9837-2c34089d6f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.218509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 818/1638] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:41:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:26.220649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69841f1c-18e7-47b0-ae0a-5f6c99e3442e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:26.268220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f0f96466-378b-41e4-9837-2c34089d6f45 None None] MFA Rules not processed for user `270785984bc645ec899aeb22a8f9054f`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:26.269454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f0f96466-378b-41e4-9837-2c34089d6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:26.277117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:26.333961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69841f1c-18e7-47b0-ae0a-5f6c99e3442e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:26.340745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3bd8-5b8a-4383-a9b3-83e7c23f3177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:26.342803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3bd8-5b8a-4383-a9b3-83e7c23f3177 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.343481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3bd8-5b8a-4383-a9b3-83e7c23f3177 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.344239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3bd8-5b8a-4383-a9b3-83e7c23f3177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.384799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:26.454609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 821/1639] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:26.454609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afda17-2b95-4abe-86f5-61740fc6e9ae None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.454609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afda17-2b95-4abe-86f5-61740fc6e9ae None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.454609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afda17-2b95-4abe-86f5-61740fc6e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.491278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3bd8-5b8a-4383-a9b3-83e7c23f3177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:26.492893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3bd8-5b8a-4383-a9b3-83e7c23f3177 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:26.516778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 819/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:26.517719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3bd8-5b8a-4383-a9b3-83e7c23f3177 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:26.528404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-73afda17-2b95-4abe-86f5-61740fc6e9ae None None] MFA Rules not processed for user `b5fa40d875e04becb472e743935fb80f`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:26.531979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-73afda17-2b95-4abe-86f5-61740fc6e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:26.543723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3bd8-5b8a-4383-a9b3-83e7c23f3177 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:26.554850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a78204-f24a-4276-823b-ad5d35973a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:26.566431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78204-f24a-4276-823b-ad5d35973a58 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.566431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78204-f24a-4276-823b-ad5d35973a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.566431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78204-f24a-4276-823b-ad5d35973a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.599433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a78204-f24a-4276-823b-ad5d35973a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:26.603252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a78204-f24a-4276-823b-ad5d35973a58 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:26.627811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 820/1641] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:26.631550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92900-5305-41c7-8ba0-e0dc27550504 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.631836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92900-5305-41c7-8ba0-e0dc27550504 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.632105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb92900-5305-41c7-8ba0-e0dc27550504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.664696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dcb92900-5305-41c7-8ba0-e0dc27550504 None None] MFA Rules not processed for user `270785984bc645ec899aeb22a8f9054f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:26.667929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dcb92900-5305-41c7-8ba0-e0dc27550504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:26.690214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 822/1642] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:26.691194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 821/1643] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:26.692946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afda17-2b95-4abe-86f5-61740fc6e9ae None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:26.706228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afda17-2b95-4abe-86f5-61740fc6e9ae None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:26.711559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ac2a-36d4-472a-99f4-9ed7bea0e1a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:26.712594 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ac2a-36d4-472a-99f4-9ed7bea0e1a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:26.712882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ac2a-36d4-472a-99f4-9ed7bea0e1a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:26.713197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ac2a-36d4-472a-99f4-9ed7bea0e1a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:26.728254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ac2a-36d4-472a-99f4-9ed7bea0e1a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:26.729993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ac2a-36d4-472a-99f4-9ed7bea0e1a6 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:26.746434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 823/1644] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:27.599395 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb92900-5305-41c7-8ba0-e0dc27550504 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:27.615442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb92900-5305-41c7-8ba0-e0dc27550504 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:27.619101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9300-ab75-4621-b789-a45f191f2497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:27.619750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9300-ab75-4621-b789-a45f191f2497 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:27.620022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9300-ab75-4621-b789-a45f191f2497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:27.620293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c9300-ab75-4621-b789-a45f191f2497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:27.691935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:27.702497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c9300-ab75-4621-b789-a45f191f2497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:27.703961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c9300-ab75-4621-b789-a45f191f2497 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:27.720482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 822/1645] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:28.110788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ac2a-36d4-472a-99f4-9ed7bea0e1a6 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:28.114359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9300-ab75-4621-b789-a45f191f2497 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:28.129720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ac2a-36d4-472a-99f4-9ed7bea0e1a6 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:28.129870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c9300-ab75-4621-b789-a45f191f2497 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:28.141883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc22bc1-4ecd-4143-be1d-cc4453740903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:28.451790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22bc1-4ecd-4143-be1d-cc4453740903 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:28.451790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22bc1-4ecd-4143-be1d-cc4453740903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:28.451790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22bc1-4ecd-4143-be1d-cc4453740903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:28.461251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49949828-5e0b-4196-9a71-903835cb755f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:28.461251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49949828-5e0b-4196-9a71-903835cb755f service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:28.461251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49949828-5e0b-4196-9a71-903835cb755f service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:28.461251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49949828-5e0b-4196-9a71-903835cb755f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:28.465846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49949828-5e0b-4196-9a71-903835cb755f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:28.465846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49949828-5e0b-4196-9a71-903835cb755f service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:28.465846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 824/1646] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:28.467884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc22bc1-4ecd-4143-be1d-cc4453740903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:28.467884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc22bc1-4ecd-4143-be1d-cc4453740903 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:28.467884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 823/1647] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:29.210410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb6ce6-b8fb-4916-bddc-518eca6e9521 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:29.210410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb6ce6-b8fb-4916-bddc-518eca6e9521 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:29.210410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb6ce6-b8fb-4916-bddc-518eca6e9521 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:29.210410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 825/1648] 10.222.0.70 () {54 vars in 912 bytes} [Wed May 18 22:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:41:29.236297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc661-8dd9-4a86-9753-da0a2beee31d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:29.237144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc661-8dd9-4a86-9753-da0a2beee31d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:29.244046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56dc661-8dd9-4a86-9753-da0a2beee31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:29.337032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d56dc661-8dd9-4a86-9753-da0a2beee31d None None] MFA Rules not processed for user `47783bb7d4cc41c6ac4c1adb682b093b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:29.338560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d56dc661-8dd9-4a86-9753-da0a2beee31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:29.428231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 824/1649] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:41:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:29.475542 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb6ce6-b8fb-4916-bddc-518eca6e9521 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:29.488609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb6ce6-b8fb-4916-bddc-518eca6e9521 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:29.494417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfa0e5-0a42-4f55-9d7d-8ad0766e2def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:29.495246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfa0e5-0a42-4f55-9d7d-8ad0766e2def service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:29.495768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfa0e5-0a42-4f55-9d7d-8ad0766e2def service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:29.496037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfa0e5-0a42-4f55-9d7d-8ad0766e2def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:29.505150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfa0e5-0a42-4f55-9d7d-8ad0766e2def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:29.506635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfa0e5-0a42-4f55-9d7d-8ad0766e2def service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:29.520009 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 826/1650] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:41:30.739161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf48c-5551-409e-b1ef-6fc173d6e5d5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:30.739764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf48c-5551-409e-b1ef-6fc173d6e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:30.739851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cf48c-5551-409e-b1ef-6fc173d6e5d5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:30.741263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 825/1651] 10.222.0.70 () {54 vars in 960 bytes} [Wed May 18 22:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:41:30.747510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684d91-ea3a-4be7-9892-e0316915d74a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:30.749053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684d91-ea3a-4be7-9892-e0316915d74a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:30.752779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2684d91-ea3a-4be7-9892-e0316915d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:30.800579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f2684d91-ea3a-4be7-9892-e0316915d74a None None] MFA Rules not processed for user `e234faadf42946058f41bd8e7b43408a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:30.808516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f2684d91-ea3a-4be7-9892-e0316915d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:30.822081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:30.977114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 827/1652] 10.222.0.70 () {58 vars in 1057 bytes} [Wed May 18 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:31.000800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf48c-5551-409e-b1ef-6fc173d6e5d5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:31.032715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cf48c-5551-409e-b1ef-6fc173d6e5d5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:31.040158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cccca-538e-4da1-81f8-d1db6767de04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:31.041143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cccca-538e-4da1-81f8-d1db6767de04 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:31.041797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cccca-538e-4da1-81f8-d1db6767de04 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:31.042919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cccca-538e-4da1-81f8-d1db6767de04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:31.047101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-da0cccca-538e-4da1-81f8-d1db6767de04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:31.084558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cccca-538e-4da1-81f8-d1db6767de04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:31.084558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cccca-538e-4da1-81f8-d1db6767de04 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:31.087945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 826/1653] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:31.904716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4fad0-c314-4385-9865-e39ea8b7868f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:31.905268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4fad0-c314-4385-9865-e39ea8b7868f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:31.905376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4fad0-c314-4385-9865-e39ea8b7868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:31.941680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-11b4fad0-c314-4385-9865-e39ea8b7868f None None] MFA Rules not processed for user `be51e8b84bb7471bb17409b331e599eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:31.943197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-11b4fad0-c314-4385-9865-e39ea8b7868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:32.059406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ff56c-1964-4dd0-a6a9-e14ccea666d9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:32.060522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ff56c-1964-4dd0-a6a9-e14ccea666d9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:32.061083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ff56c-1964-4dd0-a6a9-e14ccea666d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:32.064552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 828/1654] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:32.085497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-179ff56c-1964-4dd0-a6a9-e14ccea666d9 None None] MFA Rules not processed for user `be51e8b84bb7471bb17409b331e599eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:32.086870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-179ff56c-1964-4dd0-a6a9-e14ccea666d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:32.099928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 827/1655] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:41:32.108131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4fad0-c314-4385-9865-e39ea8b7868f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:32.126964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4fad0-c314-4385-9865-e39ea8b7868f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:32.156985 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd86d37-d8eb-4523-a2f7-9b30654da719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:32.157891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd86d37-d8eb-4523-a2f7-9b30654da719 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:32.158135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd86d37-d8eb-4523-a2f7-9b30654da719 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:32.158412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd86d37-d8eb-4523-a2f7-9b30654da719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:32.177461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd86d37-d8eb-4523-a2f7-9b30654da719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:32.179698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd86d37-d8eb-4523-a2f7-9b30654da719 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:32.205932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 829/1656] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:33.268718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41c2b-7f04-4384-bb5a-e59501fd9cd6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:33.269213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41c2b-7f04-4384-bb5a-e59501fd9cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:33.269310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae41c2b-7f04-4384-bb5a-e59501fd9cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:33.297515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6ae41c2b-7f04-4384-bb5a-e59501fd9cd6 None None] MFA Rules not processed for user `be51e8b84bb7471bb17409b331e599eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:33.299946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6ae41c2b-7f04-4384-bb5a-e59501fd9cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:33.309042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 828/1657] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:35.617570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6edd9-c39d-4f38-9bef-a37ae33ef137 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:35.618488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6edd9-c39d-4f38-9bef-a37ae33ef137 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:35.619084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6edd9-c39d-4f38-9bef-a37ae33ef137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:35.649852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7eb6edd9-c39d-4f38-9bef-a37ae33ef137 None None] MFA Rules not processed for user `f2b45df9a7cd466593d5c8a4f30bde53`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:35.652500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7eb6edd9-c39d-4f38-9bef-a37ae33ef137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:35.804112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 830/1658] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:35.819285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41c2b-7f04-4384-bb5a-e59501fd9cd6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:35.840753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae41c2b-7f04-4384-bb5a-e59501fd9cd6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:35.852499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c423201-fa5b-452b-ad35-323a68cd54dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:35.853234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c423201-fa5b-452b-ad35-323a68cd54dc service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:35.853511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c423201-fa5b-452b-ad35-323a68cd54dc service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:35.853775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c423201-fa5b-452b-ad35-323a68cd54dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:35.868997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c423201-fa5b-452b-ad35-323a68cd54dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:35.870719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c423201-fa5b-452b-ad35-323a68cd54dc service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:35.902638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 829/1659] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:38.814053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e46f2-e47d-4ef6-bb8d-d954169f5263 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:38.814597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e46f2-e47d-4ef6-bb8d-d954169f5263 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:38.814705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e46f2-e47d-4ef6-bb8d-d954169f5263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:38.832519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-970e46f2-e47d-4ef6-bb8d-d954169f5263 None None] MFA Rules not processed for user `f2b45df9a7cd466593d5c8a4f30bde53`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:38.833690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-970e46f2-e47d-4ef6-bb8d-d954169f5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:38.840841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 831/1660] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:41.198375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c423201-fa5b-452b-ad35-323a68cd54dc service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:41.208547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c423201-fa5b-452b-ad35-323a68cd54dc service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:41.212230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:41.212938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:41.213310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:41.213663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:41.224216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:41.225843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:41.256898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 830/1661] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:41.780249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e6451-6e34-4ede-9208-0dfb1b0236d8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:41.781227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e6451-6e34-4ede-9208-0dfb1b0236d8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:41.781743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e6451-6e34-4ede-9208-0dfb1b0236d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:41.789990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:41.814057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-551e6451-6e34-4ede-9208-0dfb1b0236d8 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:41.816066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-551e6451-6e34-4ede-9208-0dfb1b0236d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:41.953890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 832/1662] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:41:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:42.332121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:42.336458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:42.441781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:42.538094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c903-b2fd-4815-8c71-34006aa76b25 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:42.542515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8253b-5d79-40dc-ba9e-bb4ed178c636 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:42.549801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8253b-5d79-40dc-ba9e-bb4ed178c636 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:42.549801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8253b-5d79-40dc-ba9e-bb4ed178c636 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:42.549801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8253b-5d79-40dc-ba9e-bb4ed178c636 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:42.555614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8253b-5d79-40dc-ba9e-bb4ed178c636 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:42.557358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8253b-5d79-40dc-ba9e-bb4ed178c636 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:42.571406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 831/1663] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:41:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:41:43.925355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e6451-6e34-4ede-9208-0dfb1b0236d8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:44.074861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e6451-6e34-4ede-9208-0dfb1b0236d8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:44.078866 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8253b-5d79-40dc-ba9e-bb4ed178c636 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:44.082027 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:44.083069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:44.083395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:44.083669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] PATH_INFO: `/v3/users/2a49cfb501a24446ba4b1717bb1cafbc` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:44.085068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a49cfb501a24446ba4b1717bb1cafbc)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:44.086135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: WARNING py.warnings [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:41:44.086135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: warnings.warn(msg) May 18 22:41:44.086135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: May 18 22:41:44.097857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:44.098436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8253b-5d79-40dc-ba9e-bb4ed178c636 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:44.128380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:44.129309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:44.130313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:44.130794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] PATH_INFO: `/v3/users/eadfa254989a4950a50c1dff5abc874e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:44.133230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadfa254989a4950a50c1dff5abc874e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:44.135794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:44.772147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadfa254989a4950a50c1dff5abc874e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.794609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a49cfb501a24446ba4b1717bb1cafbc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.795503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a49cfb501a24446ba4b1717bb1cafbc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.834905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadfa254989a4950a50c1dff5abc874e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.844315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadfa254989a4950a50c1dff5abc874e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.845233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadfa254989a4950a50c1dff5abc874e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.860278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5767c557-42b2-4c94-8f34-646dd768ba65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadfa254989a4950a50c1dff5abc874e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.868083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 832/1664] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:41:44 2022] DELETE /identity/v3/users/eadfa254989a4950a50c1dff5abc874e => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:41:44.871351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7cda-a588-4634-8d81-ce9206ae41f2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:44.871931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7cda-a588-4634-8d81-ce9206ae41f2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:44.872366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c7cda-a588-4634-8d81-ce9206ae41f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:44.893705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cd9c7cda-a588-4634-8d81-ce9206ae41f2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:44.896095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cd9c7cda-a588-4634-8d81-ce9206ae41f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:44.917132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a49cfb501a24446ba4b1717bb1cafbc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.958223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a49cfb501a24446ba4b1717bb1cafbc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.981303 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-809db9cb-7bbe-4be4-a77a-4fb38b2857b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a49cfb501a24446ba4b1717bb1cafbc'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:44.995121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 833/1665] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:41:43 2022] DELETE /identity/v3/users/2a49cfb501a24446ba4b1717bb1cafbc => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:44.999828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 833/1666] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:45.001404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea26aa-cf10-41b3-acd0-5954e3d4d26a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:45.001693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea26aa-cf10-41b3-acd0-5954e3d4d26a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:45.001968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea26aa-cf10-41b3-acd0-5954e3d4d26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:45.011243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c7cda-a588-4634-8d81-ce9206ae41f2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:45.013118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cd9c7cda-a588-4634-8d81-ce9206ae41f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:45.021203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6bea26aa-cf10-41b3-acd0-5954e3d4d26a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:45.022425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6bea26aa-cf10-41b3-acd0-5954e3d4d26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:45.071633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:45.071743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:45.092277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c7cda-a588-4634-8d81-ce9206ae41f2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:45.103354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 834/1667] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:45.113633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea26aa-cf10-41b3-acd0-5954e3d4d26a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:45.147151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:45.147151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:45.147151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:45.149974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:45.158897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:45.160902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:45.173969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 834/1668] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:45.183260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea26aa-cf10-41b3-acd0-5954e3d4d26a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:45.188748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:45.188995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:45.189473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:45.189940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:45.200634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:45.202106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:45.212835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 835/1669] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:41:45.824967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:45.831503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:45.834538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:45.836284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:45.851133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b83b-54e0-4667-8762-c7ccabe08041 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:45.856718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:45.859968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:45.859968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:45.859968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] PATH_INFO: `/v3/projects/3469a2ead69c44788bf29197caaedd4e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:45.861117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3469a2ead69c44788bf29197caaedd4e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:45.863289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:45.891323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d953f8a-7b8c-477f-b3f5-a1e0b3314c0c service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:45.907170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:45.908543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:45.908832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:45.909416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] PATH_INFO: `/v3/projects/baa1d5dbae03406b9dc8f5932ec1bcbc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:45.921418 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa1d5dbae03406b9dc8f5932ec1bcbc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:45.922615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: WARNING py.warnings [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 22:41:45.922615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: warnings.warn(msg) May 18 22:41:45.922615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: May 18 22:41:45.924136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.046743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3469a2ead69c44788bf29197caaedd4e', 'request_id': 'req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.092457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa1d5dbae03406b9dc8f5932ec1bcbc', 'request_id': 'req-e41e691d-142f-4480-ae50-e9084eb07d41'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.125979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3469a2ead69c44788bf29197caaedd4e', 'request_id': 'req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.132442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3469a2ead69c44788bf29197caaedd4e', 'request_id': 'req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.144600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] The token cache is being invalidate because project 3469a2ead69c44788bf29197caaedd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:41:46.144870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.145543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4bd3476e-3c79-4d5c-b6c6-7a6a1fe8643a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.147741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 836/1670] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:41:45 2022] DELETE /identity/v3/projects/3469a2ead69c44788bf29197caaedd4e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:46.153003 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518b63-349d-4f97-96fb-93feec2addd0 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.153331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518b63-349d-4f97-96fb-93feec2addd0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.153608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f518b63-349d-4f97-96fb-93feec2addd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.174912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2f518b63-349d-4f97-96fb-93feec2addd0 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:46.176505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2f518b63-349d-4f97-96fb-93feec2addd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:46.178135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa1d5dbae03406b9dc8f5932ec1bcbc', 'request_id': 'req-e41e691d-142f-4480-ae50-e9084eb07d41'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.189675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa1d5dbae03406b9dc8f5932ec1bcbc', 'request_id': 'req-e41e691d-142f-4480-ae50-e9084eb07d41'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.213114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] The token cache is being invalidate because project baa1d5dbae03406b9dc8f5932ec1bcbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:41:46.213402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.214178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e41e691d-142f-4480-ae50-e9084eb07d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:46.215898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 835/1671] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:41:45 2022] DELETE /identity/v3/projects/baa1d5dbae03406b9dc8f5932ec1bcbc => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:46.223132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4352e81-d139-4a9d-9991-6b04d94d093a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.223476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4352e81-d139-4a9d-9991-6b04d94d093a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.224000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4352e81-d139-4a9d-9991-6b04d94d093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.238684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:46.243966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b4352e81-d139-4a9d-9991-6b04d94d093a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:46.245179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b4352e81-d139-4a9d-9991-6b04d94d093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:46.252529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 837/1672] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:41:46.257187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 836/1673] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:41:46.261344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fac99-55b0-4c64-a4c8-f269a5448082 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.261683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fac99-55b0-4c64-a4c8-f269a5448082 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.261955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fac99-55b0-4c64-a4c8-f269a5448082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.266793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4197-4978-442b-bbe7-b52df2640864 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.267081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4197-4978-442b-bbe7-b52df2640864 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.268235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4197-4978-442b-bbe7-b52df2640864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.284982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8c0fac99-55b0-4c64-a4c8-f269a5448082 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:46.286250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8c0fac99-55b0-4c64-a4c8-f269a5448082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:46.286501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-722f4197-4978-442b-bbe7-b52df2640864 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:46.287765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-722f4197-4978-442b-bbe7-b52df2640864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:46.298593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 838/1674] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:41:46.299964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 837/1675] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:41:46.303654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fac99-55b0-4c64-a4c8-f269a5448082 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.308177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4197-4978-442b-bbe7-b52df2640864 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.314070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fac99-55b0-4c64-a4c8-f269a5448082 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.316912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4197-4978-442b-bbe7-b52df2640864 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.322678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.322678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.322678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.322678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.323089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:46.323089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.323246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.323246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.323246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.323480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.323574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.323988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:46.324206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.325934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.335725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 839/1676] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:46.340053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.345614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 838/1677] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:41:46.349000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.352747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47249-9da4-4f1e-84ce-14592cb62ded admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.359699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166407b-0466-4538-92ab-4c57888d53cf admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.360471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8fe83-dac2-4f2c-ae55-a7fc89b01bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.361124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8fe83-dac2-4f2c-ae55-a7fc89b01bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.361402 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8fe83-dac2-4f2c-ae55-a7fc89b01bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.361673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8fe83-dac2-4f2c-ae55-a7fc89b01bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.362391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8fe83-dac2-4f2c-ae55-a7fc89b01bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.364446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8fe83-dac2-4f2c-ae55-a7fc89b01bb0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.364582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105efb9-fae3-4ef7-b25d-a1f8534127db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.365169 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105efb9-fae3-4ef7-b25d-a1f8534127db admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.365447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105efb9-fae3-4ef7-b25d-a1f8534127db admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.365720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105efb9-fae3-4ef7-b25d-a1f8534127db admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.366526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105efb9-fae3-4ef7-b25d-a1f8534127db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.372330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105efb9-fae3-4ef7-b25d-a1f8534127db admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.445025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 840/1678] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:41:46.449112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8fe83-dac2-4f2c-ae55-a7fc89b01bb0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.466281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 839/1679] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:41:46.472449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105efb9-fae3-4ef7-b25d-a1f8534127db admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.509100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:46.524639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8fe83-dac2-4f2c-ae55-a7fc89b01bb0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.546439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105efb9-fae3-4ef7-b25d-a1f8534127db admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.551597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389b97-1873-44f2-b1d5-27d6b034be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.552459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389b97-1873-44f2-b1d5-27d6b034be57 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.552850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389b97-1873-44f2-b1d5-27d6b034be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.553189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389b97-1873-44f2-b1d5-27d6b034be57 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.553883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0389b97-1873-44f2-b1d5-27d6b034be57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.556230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0389b97-1873-44f2-b1d5-27d6b034be57 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.586810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca1d7e-a85d-4a06-90b6-b2aa6dd773da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.587745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca1d7e-a85d-4a06-90b6-b2aa6dd773da admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.588158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca1d7e-a85d-4a06-90b6-b2aa6dd773da admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.588582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca1d7e-a85d-4a06-90b6-b2aa6dd773da admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.589207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca1d7e-a85d-4a06-90b6-b2aa6dd773da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.591311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca1d7e-a85d-4a06-90b6-b2aa6dd773da admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.687155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 841/1680] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:41:46.693897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca1d7e-a85d-4a06-90b6-b2aa6dd773da admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.710812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 840/1681] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:46.717898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389b97-1873-44f2-b1d5-27d6b034be57 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.721379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca1d7e-a85d-4a06-90b6-b2aa6dd773da admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.726337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf0587-f324-494e-b1b2-1bc2cce8222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.727115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0587-f324-494e-b1b2-1bc2cce8222f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.727465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0587-f324-494e-b1b2-1bc2cce8222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.727813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0587-f324-494e-b1b2-1bc2cce8222f admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.731285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf0587-f324-494e-b1b2-1bc2cce8222f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.733983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf0587-f324-494e-b1b2-1bc2cce8222f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.734689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389b97-1873-44f2-b1d5-27d6b034be57 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.740347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61248cf2-ed57-4049-a0c5-87e6dc18451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.742019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248cf2-ed57-4049-a0c5-87e6dc18451b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.742320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248cf2-ed57-4049-a0c5-87e6dc18451b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.742605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61248cf2-ed57-4049-a0c5-87e6dc18451b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.743371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61248cf2-ed57-4049-a0c5-87e6dc18451b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.744971 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61248cf2-ed57-4049-a0c5-87e6dc18451b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.748386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 842/1682] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:41:46.752478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf0587-f324-494e-b1b2-1bc2cce8222f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.758418 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 841/1683] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:41:46.763868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61248cf2-ed57-4049-a0c5-87e6dc18451b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.765216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf0587-f324-494e-b1b2-1bc2cce8222f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.771405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9676bd-8a21-4632-a9a2-8a17d6001a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.771405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9676bd-8a21-4632-a9a2-8a17d6001a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.771405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9676bd-8a21-4632-a9a2-8a17d6001a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.771776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9676bd-8a21-4632-a9a2-8a17d6001a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.772680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9676bd-8a21-4632-a9a2-8a17d6001a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.774330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9676bd-8a21-4632-a9a2-8a17d6001a65 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.789541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61248cf2-ed57-4049-a0c5-87e6dc18451b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.802057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 843/1684] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:41:46.802327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1ff8b-7739-4a1e-93a4-2e2af3b2ab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.802327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ff8b-7739-4a1e-93a4-2e2af3b2ab8b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.802327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ff8b-7739-4a1e-93a4-2e2af3b2ab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.802327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1ff8b-7739-4a1e-93a4-2e2af3b2ab8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.802727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1ff8b-7739-4a1e-93a4-2e2af3b2ab8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.808996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1ff8b-7739-4a1e-93a4-2e2af3b2ab8b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.809179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9676bd-8a21-4632-a9a2-8a17d6001a65 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.825194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9676bd-8a21-4632-a9a2-8a17d6001a65 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.836574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475ad5e-a400-4495-ba87-c6ff4846b6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.837556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475ad5e-a400-4495-ba87-c6ff4846b6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.838175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475ad5e-a400-4495-ba87-c6ff4846b6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.838540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475ad5e-a400-4495-ba87-c6ff4846b6a4 admin admin] PATH_INFO: `/v3/projects/cfe916805688431abc5d305c76358b04/users/9a07da0bc25a4e9ab219d56e3536890c/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.842418 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 842/1685] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:46.848164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1ff8b-7739-4a1e-93a4-2e2af3b2ab8b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:46.860688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1ff8b-7739-4a1e-93a4-2e2af3b2ab8b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:46.861029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475ad5e-a400-4495-ba87-c6ff4846b6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe916805688431abc5d305c76358b04, user_id=9a07da0bc25a4e9ab219d56e3536890c, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.866116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e10846-a0fc-4d6d-8dea-0932befbcbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:46.867186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10846-a0fc-4d6d-8dea-0932befbcbc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.867583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10846-a0fc-4d6d-8dea-0932befbcbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.868080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e10846-a0fc-4d6d-8dea-0932befbcbc5 admin admin] PATH_INFO: `/v3/projects/8233d910af2a405fa51316a93c119371/users/b95ca47ffefa486e881f7603d84352f4/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:46.868437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475ad5e-a400-4495-ba87-c6ff4846b6a4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.895636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e10846-a0fc-4d6d-8dea-0932befbcbc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8233d910af2a405fa51316a93c119371, user_id=b95ca47ffefa486e881f7603d84352f4, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:46.899773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e10846-a0fc-4d6d-8dea-0932befbcbc5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:46.987717 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 844/1686] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:46 2022] PUT /identity/v3/projects/cfe916805688431abc5d305c76358b04/users/9a07da0bc25a4e9ab219d56e3536890c/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:41:46.997548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226c93-d3c5-417a-b48a-864ce1d99fd0 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:46.997974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226c93-d3c5-417a-b48a-864ce1d99fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:46.998432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226c93-d3c5-417a-b48a-864ce1d99fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:47.015746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 843/1687] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:46 2022] PUT /identity/v3/projects/8233d910af2a405fa51316a93c119371/users/b95ca47ffefa486e881f7603d84352f4/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:41:47.020279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:47.029677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07d6d2-030d-47e9-827a-9bfe21f162a7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:47.029961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07d6d2-030d-47e9-827a-9bfe21f162a7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:47.030269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07d6d2-030d-47e9-827a-9bfe21f162a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:47.067639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5a226c93-d3c5-417a-b48a-864ce1d99fd0 None None] MFA Rules not processed for user `9a07da0bc25a4e9ab219d56e3536890c`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:47.070573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5a226c93-d3c5-417a-b48a-864ce1d99fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:47.204432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 845/1688] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:47.216194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226c93-d3c5-417a-b48a-864ce1d99fd0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:47.218708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5a226c93-d3c5-417a-b48a-864ce1d99fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:47.289647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6d07d6d2-030d-47e9-827a-9bfe21f162a7 None None] MFA Rules not processed for user `b95ca47ffefa486e881f7603d84352f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:47.293692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d07d6d2-030d-47e9-827a-9bfe21f162a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:47.358165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226c93-d3c5-417a-b48a-864ce1d99fd0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:47.376028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac056e-7c75-4a34-a3a4-87eb6b62f54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:47.376705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac056e-7c75-4a34-a3a4-87eb6b62f54e service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:47.376991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac056e-7c75-4a34-a3a4-87eb6b62f54e service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:47.377269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac056e-7c75-4a34-a3a4-87eb6b62f54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:47.383361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 844/1689] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:47.385875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac056e-7c75-4a34-a3a4-87eb6b62f54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:47.387588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac056e-7c75-4a34-a3a4-87eb6b62f54e service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:47.388070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07d6d2-030d-47e9-827a-9bfe21f162a7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:47.417229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 846/1690] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:41:47.475840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07d6d2-030d-47e9-827a-9bfe21f162a7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:47.476990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956c5c-0ae1-4efd-8df1-919243cc0386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:47.477478 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956c5c-0ae1-4efd-8df1-919243cc0386 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:47.477840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956c5c-0ae1-4efd-8df1-919243cc0386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:47.478103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8956c5c-0ae1-4efd-8df1-919243cc0386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:47.478751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8956c5c-0ae1-4efd-8df1-919243cc0386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:47.481170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8956c5c-0ae1-4efd-8df1-919243cc0386 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:47.490365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:47.562265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 845/1691] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:47 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:47.565941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac056e-7c75-4a34-a3a4-87eb6b62f54e service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:47.577196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac056e-7c75-4a34-a3a4-87eb6b62f54e service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:47.640420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef51fcd-6839-4031-960f-51949431370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:47.641094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51fcd-6839-4031-960f-51949431370e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:47.641447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51fcd-6839-4031-960f-51949431370e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:47.641639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef51fcd-6839-4031-960f-51949431370e admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:47.642418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef51fcd-6839-4031-960f-51949431370e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:47.644363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef51fcd-6839-4031-960f-51949431370e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:47.657553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956c5c-0ae1-4efd-8df1-919243cc0386 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:47.667781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8956c5c-0ae1-4efd-8df1-919243cc0386 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:47.672944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:47.673799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:47.674113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:47.674394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] PATH_INFO: `/v3/users/9a07da0bc25a4e9ab219d56e3536890c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:47.675595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a07da0bc25a4e9ab219d56e3536890c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:47.677555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:47.749006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 847/1692] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:47 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:47.753028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef51fcd-6839-4031-960f-51949431370e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:47.762451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef51fcd-6839-4031-960f-51949431370e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:47.767289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086189ee-15ca-4325-98a5-59233feab1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:47.767909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086189ee-15ca-4325-98a5-59233feab1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:47.768186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086189ee-15ca-4325-98a5-59233feab1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:47.768450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086189ee-15ca-4325-98a5-59233feab1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:47.769151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086189ee-15ca-4325-98a5-59233feab1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:47.770760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086189ee-15ca-4325-98a5-59233feab1c3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:47.772707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:47.781968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 848/1693] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:41:47.789226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086189ee-15ca-4325-98a5-59233feab1c3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:47.799605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086189ee-15ca-4325-98a5-59233feab1c3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:47.804705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27908e9-b0a1-4fef-a01c-12b162e4c0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:47.805791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27908e9-b0a1-4fef-a01c-12b162e4c0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:47.806092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27908e9-b0a1-4fef-a01c-12b162e4c0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:47.806369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27908e9-b0a1-4fef-a01c-12b162e4c0fc admin admin] PATH_INFO: `/v3/projects/c0007fa8bc2b4b86a1ab522ee9c28e94/users/92a278a6f142414da1d35651ccce7d35/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:47.821789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27908e9-b0a1-4fef-a01c-12b162e4c0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0007fa8bc2b4b86a1ab522ee9c28e94, user_id=92a278a6f142414da1d35651ccce7d35, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:47.829366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27908e9-b0a1-4fef-a01c-12b162e4c0fc admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:47.897140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a07da0bc25a4e9ab219d56e3536890c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:47.977652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 849/1694] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:47 2022] PUT /identity/v3/projects/c0007fa8bc2b4b86a1ab522ee9c28e94/users/92a278a6f142414da1d35651ccce7d35/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:41:47.981526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27908e9-b0a1-4fef-a01c-12b162e4c0fc admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:48.038489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a07da0bc25a4e9ab219d56e3536890c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:48.045434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27908e9-b0a1-4fef-a01c-12b162e4c0fc admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:48.052617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801820-7bf2-41ed-9368-aad2b38ab0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:48.053324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801820-7bf2-41ed-9368-aad2b38ab0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:48.053601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801820-7bf2-41ed-9368-aad2b38ab0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:48.053941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801820-7bf2-41ed-9368-aad2b38ab0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:48.059408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801820-7bf2-41ed-9368-aad2b38ab0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:48.059408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801820-7bf2-41ed-9368-aad2b38ab0a6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:48.062923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a07da0bc25a4e9ab219d56e3536890c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:48.065544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a07da0bc25a4e9ab219d56e3536890c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:48.071630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 850/1695] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:41:48.075654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801820-7bf2-41ed-9368-aad2b38ab0a6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:48.086388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801820-7bf2-41ed-9368-aad2b38ab0a6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:48.106833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7149f3e-0b3d-4280-b3d4-249e862b4e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:48.108554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149f3e-0b3d-4280-b3d4-249e862b4e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:48.108941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149f3e-0b3d-4280-b3d4-249e862b4e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:48.109307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7149f3e-0b3d-4280-b3d4-249e862b4e39 admin admin] PATH_INFO: `/v3/projects/c0007fa8bc2b4b86a1ab522ee9c28e94/users/92a278a6f142414da1d35651ccce7d35/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:48.110377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-08827eb7-c2c2-41bb-8c1c-b06d6fe9eb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a07da0bc25a4e9ab219d56e3536890c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:48.111533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7149f3e-0b3d-4280-b3d4-249e862b4e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0007fa8bc2b4b86a1ab522ee9c28e94, user_id=92a278a6f142414da1d35651ccce7d35, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:48.114945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7149f3e-0b3d-4280-b3d4-249e862b4e39 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:48.117440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 846/1696] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:41:47 2022] DELETE /identity/v3/users/9a07da0bc25a4e9ab219d56e3536890c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:41:48.125626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816146d-fc59-4a77-9ba2-028da585bec3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:48.125626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816146d-fc59-4a77-9ba2-028da585bec3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:48.125626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816146d-fc59-4a77-9ba2-028da585bec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:48.131095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 851/1697] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:48 2022] PUT /identity/v3/projects/c0007fa8bc2b4b86a1ab522ee9c28e94/users/92a278a6f142414da1d35651ccce7d35/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:48.142241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e816146d-fc59-4a77-9ba2-028da585bec3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:48.143006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c450-c8ec-4afe-ace0-64aeb701eb9b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:48.143374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c450-c8ec-4afe-ace0-64aeb701eb9b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:48.143479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e816146d-fc59-4a77-9ba2-028da585bec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:48.143797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8c450-c8ec-4afe-ace0-64aeb701eb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:48.176534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b1b8c450-c8ec-4afe-ace0-64aeb701eb9b None None] MFA Rules not processed for user `92a278a6f142414da1d35651ccce7d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:48.178165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b1b8c450-c8ec-4afe-ace0-64aeb701eb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:48.209295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 847/1698] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:41:48.215908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816146d-fc59-4a77-9ba2-028da585bec3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:48.217367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e816146d-fc59-4a77-9ba2-028da585bec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:48.274944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 852/1699] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:41:48.282510 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816146d-fc59-4a77-9ba2-028da585bec3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:48.286233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea1545-42e7-455d-a8ec-aa9ec9bd081e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:48.286452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8c450-c8ec-4afe-ace0-64aeb701eb9b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:48.286877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea1545-42e7-455d-a8ec-aa9ec9bd081e service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:48.287154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea1545-42e7-455d-a8ec-aa9ec9bd081e service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:48.287427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea1545-42e7-455d-a8ec-aa9ec9bd081e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:48.287837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b1b8c450-c8ec-4afe-ace0-64aeb701eb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:48.297045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea1545-42e7-455d-a8ec-aa9ec9bd081e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:48.298650 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea1545-42e7-455d-a8ec-aa9ec9bd081e service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:48.312303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 848/1700] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:41:48.335427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:48.346836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8c450-c8ec-4afe-ace0-64aeb701eb9b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:48.350879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:48.351523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:48.351799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:48.352071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:48.362299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:48.363869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:48.375639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 853/1701] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:48.581917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea1545-42e7-455d-a8ec-aa9ec9bd081e service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:48.587011 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:48.592227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea1545-42e7-455d-a8ec-aa9ec9bd081e service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:48.596155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b11cd-0ea0-448f-b6d0-a420d7d7e43b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:48.597111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b11cd-0ea0-448f-b6d0-a420d7d7e43b service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:48.597454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b11cd-0ea0-448f-b6d0-a420d7d7e43b service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:48.597797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b11cd-0ea0-448f-b6d0-a420d7d7e43b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:48.599698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-356b11cd-0ea0-448f-b6d0-a420d7d7e43b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:48.692968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b11cd-0ea0-448f-b6d0-a420d7d7e43b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:48.694764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b11cd-0ea0-448f-b6d0-a420d7d7e43b service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:48.706675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 849/1702] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:48.801932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:48.803367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:48.818724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c01e-744b-4adb-bee1-0503f121ef94 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:48.823425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:48.826169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:48.826169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:48.826169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] PATH_INFO: `/v3/projects/cfe916805688431abc5d305c76358b04` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:48.826169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe916805688431abc5d305c76358b04)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:48.828031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:48.989162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe916805688431abc5d305c76358b04', 'request_id': 'req-17627176-4b02-427d-85d7-5e58271daff6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:49.093349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe916805688431abc5d305c76358b04', 'request_id': 'req-17627176-4b02-427d-85d7-5e58271daff6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:49.101766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe916805688431abc5d305c76358b04', 'request_id': 'req-17627176-4b02-427d-85d7-5e58271daff6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:49.120015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] The token cache is being invalidate because project cfe916805688431abc5d305c76358b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:41:49.120315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:49.120971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-17627176-4b02-427d-85d7-5e58271daff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:41:49.122578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 854/1703] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:41:48 2022] DELETE /identity/v3/projects/cfe916805688431abc5d305c76358b04 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:49.130145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16b30a-bb61-4d17-bc60-439903fabab0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.130568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16b30a-bb61-4d17-bc60-439903fabab0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.131004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16b30a-bb61-4d17-bc60-439903fabab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.167319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2f16b30a-bb61-4d17-bc60-439903fabab0 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:49.168702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2f16b30a-bb61-4d17-bc60-439903fabab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:49.241030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 850/1704] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:49.248903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b333e-a1ca-4c83-9d7d-6516cad23dde None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.249193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b333e-a1ca-4c83-9d7d-6516cad23dde None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.249492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b333e-a1ca-4c83-9d7d-6516cad23dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.286045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f88b333e-a1ca-4c83-9d7d-6516cad23dde None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:49.290376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f88b333e-a1ca-4c83-9d7d-6516cad23dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:49.302381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 855/1705] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:49.307277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16b30a-bb61-4d17-bc60-439903fabab0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:49.320623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16b30a-bb61-4d17-bc60-439903fabab0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:49.325344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:49.326847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.327123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.327387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.328108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:41:49.328407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:49.330039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:49.341775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 851/1706] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:41:49.346237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b333e-a1ca-4c83-9d7d-6516cad23dde None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:49.355917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b333e-a1ca-4c83-9d7d-6516cad23dde None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:49.361301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a03ca5-a814-4f3e-b58d-29350db4939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:49.362034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a03ca5-a814-4f3e-b58d-29350db4939b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.362484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a03ca5-a814-4f3e-b58d-29350db4939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.362766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a03ca5-a814-4f3e-b58d-29350db4939b admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.363470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a03ca5-a814-4f3e-b58d-29350db4939b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:49.365432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a03ca5-a814-4f3e-b58d-29350db4939b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:49.447654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 856/1707] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:49 2022] POST /identity/v3/projects => generated 409 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:49.451947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:49.462077 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670cda-c842-41a2-9ba8-3f230b264b80 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:49.561002 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0033-0ff4-41f7-81f8-805761d233f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:49.561628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0033-0ff4-41f7-81f8-805761d233f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.561911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0033-0ff4-41f7-81f8-805761d233f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.562235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0033-0ff4-41f7-81f8-805761d233f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.562931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac0033-0ff4-41f7-81f8-805761d233f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:49.564851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac0033-0ff4-41f7-81f8-805761d233f6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:49.670807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 852/1708] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:49 2022] POST /identity/v3/users => generated 305 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:41:49.674639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a03ca5-a814-4f3e-b58d-29350db4939b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:49.688234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a03ca5-a814-4f3e-b58d-29350db4939b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:49.693608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b214cd-099a-4e0b-a79a-0f6236acc413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:49.694374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b214cd-099a-4e0b-a79a-0f6236acc413 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.694947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b214cd-099a-4e0b-a79a-0f6236acc413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.695245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b214cd-099a-4e0b-a79a-0f6236acc413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.696797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b214cd-099a-4e0b-a79a-0f6236acc413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:49.698454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b214cd-099a-4e0b-a79a-0f6236acc413 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:49.710615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 857/1709] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:49.714754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0033-0ff4-41f7-81f8-805761d233f6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:49.725659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0033-0ff4-41f7-81f8-805761d233f6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:49.732926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d96e1b-094c-4fea-af1d-ba2fe0e69592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:49.732926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d96e1b-094c-4fea-af1d-ba2fe0e69592 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.732926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d96e1b-094c-4fea-af1d-ba2fe0e69592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.732926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d96e1b-094c-4fea-af1d-ba2fe0e69592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.733216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d96e1b-094c-4fea-af1d-ba2fe0e69592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:49.734470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d96e1b-094c-4fea-af1d-ba2fe0e69592 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:49.748689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 853/1710] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:49.749903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b214cd-099a-4e0b-a79a-0f6236acc413 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:49.759984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b214cd-099a-4e0b-a79a-0f6236acc413 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:49.765064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be0613-cc70-4533-b8af-ab71ccb764a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:49.766264 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be0613-cc70-4533-b8af-ab71ccb764a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.766541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be0613-cc70-4533-b8af-ab71ccb764a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.766808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be0613-cc70-4533-b8af-ab71ccb764a4 admin admin] PATH_INFO: `/v3/projects/fda85f5bcea04cc39a68bfbfbd8eae70/users/da5c865be8674fb5ba8004192c73a917/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.782477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be0613-cc70-4533-b8af-ab71ccb764a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda85f5bcea04cc39a68bfbfbd8eae70, user_id=da5c865be8674fb5ba8004192c73a917, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:49.790206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be0613-cc70-4533-b8af-ab71ccb764a4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:49.876405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 858/1711] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:49 2022] PUT /identity/v3/projects/fda85f5bcea04cc39a68bfbfbd8eae70/users/da5c865be8674fb5ba8004192c73a917/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:41:49.889127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55f5a4-a2df-4877-ab24-d1cda2513236 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:49.889853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55f5a4-a2df-4877-ab24-d1cda2513236 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:49.890353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55f5a4-a2df-4877-ab24-d1cda2513236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:49.903069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:49.917173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fa55f5a4-a2df-4877-ab24-d1cda2513236 None None] MFA Rules not processed for user `da5c865be8674fb5ba8004192c73a917`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:49.918417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fa55f5a4-a2df-4877-ab24-d1cda2513236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:49.983007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 854/1712] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:49.987453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be0613-cc70-4533-b8af-ab71ccb764a4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:50.056598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be0613-cc70-4533-b8af-ab71ccb764a4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:50.056598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec9e0d-4217-4b4c-be1d-0917dab9769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:50.056995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9e0d-4217-4b4c-be1d-0917dab9769c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:50.057284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9e0d-4217-4b4c-be1d-0917dab9769c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:50.057555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9e0d-4217-4b4c-be1d-0917dab9769c admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:50.058285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec9e0d-4217-4b4c-be1d-0917dab9769c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:50.060740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec9e0d-4217-4b4c-be1d-0917dab9769c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:50.069964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:50.150595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 859/1713] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:41:49 2022] POST /identity/v3/projects => generated 409 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:50.154552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55f5a4-a2df-4877-ab24-d1cda2513236 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:50.165706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55f5a4-a2df-4877-ab24-d1cda2513236 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:50.224390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ae7c3-8c47-4814-8afa-f9cd5beb739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:50.225064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae7c3-8c47-4814-8afa-f9cd5beb739d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:50.225348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae7c3-8c47-4814-8afa-f9cd5beb739d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:50.225626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ae7c3-8c47-4814-8afa-f9cd5beb739d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:50.226367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ae7c3-8c47-4814-8afa-f9cd5beb739d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:50.228258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ae7c3-8c47-4814-8afa-f9cd5beb739d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:50.299245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 855/1714] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:41:50 2022] POST /identity/v3/users => generated 311 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:41:50.303254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec9e0d-4217-4b4c-be1d-0917dab9769c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:50.317170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec9e0d-4217-4b4c-be1d-0917dab9769c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:50.324671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc33ad7-ccce-46c9-9603-b458c35616cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:50.325418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc33ad7-ccce-46c9-9603-b458c35616cd admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:50.326272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc33ad7-ccce-46c9-9603-b458c35616cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:50.326905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc33ad7-ccce-46c9-9603-b458c35616cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:50.327929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc33ad7-ccce-46c9-9603-b458c35616cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:50.329678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc33ad7-ccce-46c9-9603-b458c35616cd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:50.344595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 860/1715] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:50.348775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ae7c3-8c47-4814-8afa-f9cd5beb739d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:50.361787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ae7c3-8c47-4814-8afa-f9cd5beb739d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:50.368853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574accda-3cda-476d-b30d-a3a4139f93f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:50.369895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574accda-3cda-476d-b30d-a3a4139f93f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:50.370453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574accda-3cda-476d-b30d-a3a4139f93f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:50.371014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574accda-3cda-476d-b30d-a3a4139f93f3 admin admin] PATH_INFO: `/v3/projects/3aed4738014a48b0b01157aa1265a8db/users/7a9b7ac0be174f8abb1464340e345319/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:50.392043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574accda-3cda-476d-b30d-a3a4139f93f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aed4738014a48b0b01157aa1265a8db, user_id=7a9b7ac0be174f8abb1464340e345319, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:50.395550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574accda-3cda-476d-b30d-a3a4139f93f3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:50.499069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 856/1716] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:50 2022] PUT /identity/v3/projects/3aed4738014a48b0b01157aa1265a8db/users/7a9b7ac0be174f8abb1464340e345319/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:41:50.499164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc33ad7-ccce-46c9-9603-b458c35616cd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:50.508993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc33ad7-ccce-46c9-9603-b458c35616cd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:50.588196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90c9ca-0f31-4078-919c-474c8beafab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:50.588820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c9ca-0f31-4078-919c-474c8beafab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:50.589103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c9ca-0f31-4078-919c-474c8beafab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:50.589375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c9ca-0f31-4078-919c-474c8beafab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:50.590139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c9ca-0f31-4078-919c-474c8beafab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:50.592280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c9ca-0f31-4078-919c-474c8beafab8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:50.602442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 861/1717] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:41:50.606433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574accda-3cda-476d-b30d-a3a4139f93f3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:50.617176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574accda-3cda-476d-b30d-a3a4139f93f3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:50.621765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:50.622756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:50.623181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:50.623420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] PATH_INFO: `/v3/projects/3aed4738014a48b0b01157aa1265a8db/users/7a9b7ac0be174f8abb1464340e345319/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:50.625417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aed4738014a48b0b01157aa1265a8db, user_id=7a9b7ac0be174f8abb1464340e345319, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:50.628047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:50.638962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 857/1718] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:41:50 2022] PUT /identity/v3/projects/3aed4738014a48b0b01157aa1265a8db/users/7a9b7ac0be174f8abb1464340e345319/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:41:50.649101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbeb7-089a-4938-99cb-b779ef0e9623 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:50.649373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbeb7-089a-4938-99cb-b779ef0e9623 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:50.649643 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fbeb7-089a-4938-99cb-b779ef0e9623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:50.678619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1f8fbeb7-089a-4938-99cb-b779ef0e9623 None None] MFA Rules not processed for user `7a9b7ac0be174f8abb1464340e345319`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:50.680029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1f8fbeb7-089a-4938-99cb-b779ef0e9623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:50.776701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 862/1719] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:41:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:41:50.789919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:50.792711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:50.881700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:50.890735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7f76f-7f63-4c0d-bee3-c4419608c434 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:50.900842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7009c9-4558-45ab-a5be-bf2b0b81d9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:50.901505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7009c9-4558-45ab-a5be-bf2b0b81d9fd service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:50.901911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7009c9-4558-45ab-a5be-bf2b0b81d9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:50.902136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7009c9-4558-45ab-a5be-bf2b0b81d9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:50.914680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7009c9-4558-45ab-a5be-bf2b0b81d9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:50.918358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7009c9-4558-45ab-a5be-bf2b0b81d9fd service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:50.937320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 858/1720] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:50 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:51.412537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fbeb7-089a-4938-99cb-b779ef0e9623 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:51.414148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1f8fbeb7-089a-4938-99cb-b779ef0e9623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:51.427479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fbeb7-089a-4938-99cb-b779ef0e9623 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:51.431679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:51.432350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:51.432870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:51.433345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:51.500824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:51.502660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:51.506800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:51.515354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 863/1721] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:58.252714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016333c-89f1-4c1f-bf57-27b3e3218f86 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:58.253126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016333c-89f1-4c1f-bf57-27b3e3218f86 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:58.253207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016333c-89f1-4c1f-bf57-27b3e3218f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:58.284146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4016333c-89f1-4c1f-bf57-27b3e3218f86 None None] MFA Rules not processed for user `47783bb7d4cc41c6ac4c1adb682b093b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:41:58.286338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4016333c-89f1-4c1f-bf57-27b3e3218f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:58.349915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 859/1722] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 18 22:41:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:41:58.432612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:58.434277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:58.440784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016333c-89f1-4c1f-bf57-27b3e3218f86 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:58.442244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4016333c-89f1-4c1f-bf57-27b3e3218f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:41:58.452256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8dfbb-35a9-4fc2-8e05-474b992dafae service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:58.456910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783ce7-d544-423b-a8ee-471fff42713f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:58.457609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783ce7-d544-423b-a8ee-471fff42713f service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:58.459285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783ce7-d544-423b-a8ee-471fff42713f service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:58.459285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd783ce7-d544-423b-a8ee-471fff42713f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:58.460857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016333c-89f1-4c1f-bf57-27b3e3218f86 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:58.465521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13224d-e497-423f-bf7c-50ec78cdd61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:58.466553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13224d-e497-423f-bf7c-50ec78cdd61f service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:58.467457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783ce7-d544-423b-a8ee-471fff42713f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:58.467654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13224d-e497-423f-bf7c-50ec78cdd61f service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:58.468241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13224d-e497-423f-bf7c-50ec78cdd61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:58.468903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd783ce7-d544-423b-a8ee-471fff42713f service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:58.478336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 864/1723] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:41:58.479166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783ce7-d544-423b-a8ee-471fff42713f service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:41:58.480835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13224d-e497-423f-bf7c-50ec78cdd61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:58.484499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13224d-e497-423f-bf7c-50ec78cdd61f service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:58.488544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd783ce7-d544-423b-a8ee-471fff42713f service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:41:58.493621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c8b15-ba94-43d5-a5c2-56b50986fbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:41:58.494387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c8b15-ba94-43d5-a5c2-56b50986fbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:41:58.505111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c8b15-ba94-43d5-a5c2-56b50986fbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:41:58.505111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c8b15-ba94-43d5-a5c2-56b50986fbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:41:58.505565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 860/1724] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:41:58.505662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c8b15-ba94-43d5-a5c2-56b50986fbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:41:58.506243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c8b15-ba94-43d5-a5c2-56b50986fbc8 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:41:58.515476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 865/1725] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:41:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:00.077040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae85caa-4571-45bc-804b-8629584c6b6a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:00.077521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae85caa-4571-45bc-804b-8629584c6b6a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:00.077718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae85caa-4571-45bc-804b-8629584c6b6a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:00.079886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 861/1726] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:42:00.090982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff93d5-4e97-4471-917a-d23a98c4d458 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:00.092311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff93d5-4e97-4471-917a-d23a98c4d458 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:00.093108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff93d5-4e97-4471-917a-d23a98c4d458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:00.119548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-66ff93d5-4e97-4471-917a-d23a98c4d458 None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:00.121128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-66ff93d5-4e97-4471-917a-d23a98c4d458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:00.243971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 866/1727] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:00.257238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae85caa-4571-45bc-804b-8629584c6b6a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:00.259302 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2ae85caa-4571-45bc-804b-8629584c6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:00.282542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae85caa-4571-45bc-804b-8629584c6b6a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:00.294983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794470d7-14a3-4562-b866-e151a1801f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:00.295964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794470d7-14a3-4562-b866-e151a1801f23 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:00.296247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794470d7-14a3-4562-b866-e151a1801f23 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:00.296526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794470d7-14a3-4562-b866-e151a1801f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:00.306815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794470d7-14a3-4562-b866-e151a1801f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:00.310969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794470d7-14a3-4562-b866-e151a1801f23 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:00.326876 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 862/1728] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:00.611029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61660-3f47-430d-80d2-eeb5ac6674a6 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:00.611342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61660-3f47-430d-80d2-eeb5ac6674a6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:00.611832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba61660-3f47-430d-80d2-eeb5ac6674a6 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:00.613759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 867/1729] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:42:00.643576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7249d-9911-4e72-84f8-073a8c8884f7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:00.644587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7249d-9911-4e72-84f8-073a8c8884f7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:00.644764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7249d-9911-4e72-84f8-073a8c8884f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:00.677623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c2a7249d-9911-4e72-84f8-073a8c8884f7 None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:00.679097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c2a7249d-9911-4e72-84f8-073a8c8884f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:00.690520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 863/1730] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:00.715429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba61660-3f47-430d-80d2-eeb5ac6674a6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:00.715429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0ba61660-3f47-430d-80d2-eeb5ac6674a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:00.734527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba61660-3f47-430d-80d2-eeb5ac6674a6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:00.740423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853ab3d-53be-4e74-b9f8-e74378746428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:00.741085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853ab3d-53be-4e74-b9f8-e74378746428 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:00.741374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853ab3d-53be-4e74-b9f8-e74378746428 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:00.741653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853ab3d-53be-4e74-b9f8-e74378746428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:00.752205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853ab3d-53be-4e74-b9f8-e74378746428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:00.753749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853ab3d-53be-4e74-b9f8-e74378746428 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:00.765704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 868/1731] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:10.667632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=42 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:10.760068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=50 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:17.437322 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7249d-9911-4e72-84f8-073a8c8884f7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:17.498217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7249d-9911-4e72-84f8-073a8c8884f7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:17.503332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:17.504194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:17.504474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:17.504747 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] PATH_INFO: `/v3/users/da5c865be8674fb5ba8004192c73a917` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:17.505951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5c865be8674fb5ba8004192c73a917)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:17.507871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:17.664636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5c865be8674fb5ba8004192c73a917'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:17.731025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5c865be8674fb5ba8004192c73a917'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:17.740038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5c865be8674fb5ba8004192c73a917'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:17.740702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5c865be8674fb5ba8004192c73a917'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:17.754442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5c865be8674fb5ba8004192c73a917'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:17.761496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 864/1732] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:17 2022] DELETE /identity/v3/users/da5c865be8674fb5ba8004192c73a917 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:17.765959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfc310-e6c5-455e-a9dc-31aa70e1fac1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:17.766446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfc310-e6c5-455e-a9dc-31aa70e1fac1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:17.766621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfc310-e6c5-455e-a9dc-31aa70e1fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:17.785644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-06cfc310-e6c5-455e-a9dc-31aa70e1fac1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:17.786986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-06cfc310-e6c5-455e-a9dc-31aa70e1fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:17.853875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 869/1733] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:17.864696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:17.866133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:17.928499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ecbdf-6c1b-48c9-9107-0cd481e3f46d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:17.932375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ae049-0b11-4857-a271-0957a5073f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:17.933020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae049-0b11-4857-a271-0957a5073f83 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:17.933301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae049-0b11-4857-a271-0957a5073f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:17.933578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae049-0b11-4857-a271-0957a5073f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:17.942952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ae049-0b11-4857-a271-0957a5073f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:17.944373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ae049-0b11-4857-a271-0957a5073f83 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:17.953984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 865/1734] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:18.306032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfc310-e6c5-455e-a9dc-31aa70e1fac1 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:18.307509 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-06cfc310-e6c5-455e-a9dc-31aa70e1fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:18.319725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfc310-e6c5-455e-a9dc-31aa70e1fac1 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:18.324416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:18.325282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:18.325556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:18.325846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] PATH_INFO: `/v3/projects/fda85f5bcea04cc39a68bfbfbd8eae70` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:18.327628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda85f5bcea04cc39a68bfbfbd8eae70)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:18.329579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:18.422831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda85f5bcea04cc39a68bfbfbd8eae70', 'request_id': 'req-99f04de7-39e7-485b-a28a-c0e740a6a871'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.484160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda85f5bcea04cc39a68bfbfbd8eae70', 'request_id': 'req-99f04de7-39e7-485b-a28a-c0e740a6a871'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.490192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda85f5bcea04cc39a68bfbfbd8eae70', 'request_id': 'req-99f04de7-39e7-485b-a28a-c0e740a6a871'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.501602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] The token cache is being invalidate because project fda85f5bcea04cc39a68bfbfbd8eae70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:18.501883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.502538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.504066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 870/1735] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:18 2022] DELETE /identity/v3/projects/fda85f5bcea04cc39a68bfbfbd8eae70 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:18.508153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ae049-0b11-4857-a271-0957a5073f83 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:18.518543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ae049-0b11-4857-a271-0957a5073f83 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:18.537473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:18.575621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:18.576760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:18.577839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:18.578239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] PATH_INFO: `/v3/users/7a9b7ac0be174f8abb1464340e345319` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:18.579741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9b7ac0be174f8abb1464340e345319)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:18.581827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:18.791870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9b7ac0be174f8abb1464340e345319'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.868387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9b7ac0be174f8abb1464340e345319'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.877100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9b7ac0be174f8abb1464340e345319'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.878430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9b7ac0be174f8abb1464340e345319'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.891344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-935bbda3-acdb-4c4e-80bd-d3937dfd9586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9b7ac0be174f8abb1464340e345319'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:18.897762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 866/1736] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:18 2022] DELETE /identity/v3/users/7a9b7ac0be174f8abb1464340e345319 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:19.478486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:19.481097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:19.496567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f04de7-39e7-485b-a28a-c0e740a6a871 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:19.557594 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:19.558513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:19.558800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:19.565781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] PATH_INFO: `/v3/projects/3aed4738014a48b0b01157aa1265a8db` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:19.565781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aed4738014a48b0b01157aa1265a8db)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:19.565781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:19.623867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:19.641940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aed4738014a48b0b01157aa1265a8db', 'request_id': 'req-5a45a873-f35d-4b89-9007-3fd82c17b12e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:19.707951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aed4738014a48b0b01157aa1265a8db', 'request_id': 'req-5a45a873-f35d-4b89-9007-3fd82c17b12e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:19.714354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aed4738014a48b0b01157aa1265a8db', 'request_id': 'req-5a45a873-f35d-4b89-9007-3fd82c17b12e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:19.725905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] The token cache is being invalidate because project 3aed4738014a48b0b01157aa1265a8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:19.726239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:19.726858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a45a873-f35d-4b89-9007-3fd82c17b12e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:19.728381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 871/1737] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:19 2022] DELETE /identity/v3/projects/3aed4738014a48b0b01157aa1265a8db => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:19.733276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680c53-1c66-487f-8b65-dbaf9fc1057a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:19.734062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680c53-1c66-487f-8b65-dbaf9fc1057a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:19.734062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a680c53-1c66-487f-8b65-dbaf9fc1057a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:19.751673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4a680c53-1c66-487f-8b65-dbaf9fc1057a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:19.752859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4a680c53-1c66-487f-8b65-dbaf9fc1057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:19.810815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 867/1738] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:19.820094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b8a24-3c00-45c7-b1dd-b1d54d601e42 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:19.820373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b8a24-3c00-45c7-b1dd-b1d54d601e42 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:19.820643 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b8a24-3c00-45c7-b1dd-b1d54d601e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:19.839274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fe4b8a24-3c00-45c7-b1dd-b1d54d601e42 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:19.840445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fe4b8a24-3c00-45c7-b1dd-b1d54d601e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:19.848320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 872/1739] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:19.852451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a680c53-1c66-487f-8b65-dbaf9fc1057a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:19.862856 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a680c53-1c66-487f-8b65-dbaf9fc1057a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:19.867360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:19.868007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:19.868287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:19.868561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:19.869303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:42:19.869594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:19.871213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:19.883185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 868/1740] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:42:19.887436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b8a24-3c00-45c7-b1dd-b1d54d601e42 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:19.896514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b8a24-3c00-45c7-b1dd-b1d54d601e42 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:19.901055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa243f-87e9-4d05-ac26-f55078c87401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:19.901968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa243f-87e9-4d05-ac26-f55078c87401 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:19.902282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa243f-87e9-4d05-ac26-f55078c87401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:19.902550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa243f-87e9-4d05-ac26-f55078c87401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:19.903251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa243f-87e9-4d05-ac26-f55078c87401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:19.905154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa243f-87e9-4d05-ac26-f55078c87401 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:20.007033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 873/1741] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:19 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:20.011333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:20.022603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9de348-dbe6-490a-ba32-b7c5e2da20f7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:20.066069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:20.099072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f46ebf-8c0d-4fe8-b760-d0ddf1f63b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:20.099729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f46ebf-8c0d-4fe8-b760-d0ddf1f63b03 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.100017 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f46ebf-8c0d-4fe8-b760-d0ddf1f63b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.100290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f46ebf-8c0d-4fe8-b760-d0ddf1f63b03 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.100983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f46ebf-8c0d-4fe8-b760-d0ddf1f63b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:20.102967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f46ebf-8c0d-4fe8-b760-d0ddf1f63b03 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:20.183408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 869/1742] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:20 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:20.187564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa243f-87e9-4d05-ac26-f55078c87401 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:20.198050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa243f-87e9-4d05-ac26-f55078c87401 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:20.203817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2043a6-9352-41e5-a2d0-ca6e8ed9ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:20.204480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2043a6-9352-41e5-a2d0-ca6e8ed9ed90 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.204763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2043a6-9352-41e5-a2d0-ca6e8ed9ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.205068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2043a6-9352-41e5-a2d0-ca6e8ed9ed90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.205831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2043a6-9352-41e5-a2d0-ca6e8ed9ed90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:20.207638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2043a6-9352-41e5-a2d0-ca6e8ed9ed90 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:20.222793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 874/1743] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:20.223674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f46ebf-8c0d-4fe8-b760-d0ddf1f63b03 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:20.233988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f46ebf-8c0d-4fe8-b760-d0ddf1f63b03 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:20.238688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee2e81-b080-41f7-a6c0-17c4c5d133ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:20.247658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2e81-b080-41f7-a6c0-17c4c5d133ed admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.247658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2e81-b080-41f7-a6c0-17c4c5d133ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.247658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee2e81-b080-41f7-a6c0-17c4c5d133ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.247658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee2e81-b080-41f7-a6c0-17c4c5d133ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:20.247658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fee2e81-b080-41f7-a6c0-17c4c5d133ed admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:20.258913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 870/1744] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:20.262904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2043a6-9352-41e5-a2d0-ca6e8ed9ed90 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:20.273619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2043a6-9352-41e5-a2d0-ca6e8ed9ed90 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:20.278508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e9709-faad-4bce-b405-4479b32a69a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:20.279476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9709-faad-4bce-b405-4479b32a69a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.279818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9709-faad-4bce-b405-4479b32a69a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.280226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e9709-faad-4bce-b405-4479b32a69a1 admin admin] PATH_INFO: `/v3/projects/f7dd6ef4dc6e4d8b9c5021e4bda6b350/users/d97b260d717e4b119eba1402ba1ad489/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.303512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e9709-faad-4bce-b405-4479b32a69a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7dd6ef4dc6e4d8b9c5021e4bda6b350, user_id=d97b260d717e4b119eba1402ba1ad489, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:20.306972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e9709-faad-4bce-b405-4479b32a69a1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:20.405815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 875/1745] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:20 2022] PUT /identity/v3/projects/f7dd6ef4dc6e4d8b9c5021e4bda6b350/users/d97b260d717e4b119eba1402ba1ad489/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:20.420681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bdd1e-79c6-49d8-93aa-7ead6078527c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.421040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bdd1e-79c6-49d8-93aa-7ead6078527c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.421399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bdd1e-79c6-49d8-93aa-7ead6078527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.451274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d38bdd1e-79c6-49d8-93aa-7ead6078527c None None] MFA Rules not processed for user `d97b260d717e4b119eba1402ba1ad489`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:20.453643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d38bdd1e-79c6-49d8-93aa-7ead6078527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:20.519407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 871/1746] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:20.524054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e9709-faad-4bce-b405-4479b32a69a1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:20.588300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e9709-faad-4bce-b405-4479b32a69a1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:20.593056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef76d71-658d-45a0-ba2a-ac4ce0d37263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:20.593783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76d71-658d-45a0-ba2a-ac4ce0d37263 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.594119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76d71-658d-45a0-ba2a-ac4ce0d37263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.594399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef76d71-658d-45a0-ba2a-ac4ce0d37263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.595099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76d71-658d-45a0-ba2a-ac4ce0d37263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:20.596998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef76d71-658d-45a0-ba2a-ac4ce0d37263 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:20.715699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 876/1747] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:20 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:20.721360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bdd1e-79c6-49d8-93aa-7ead6078527c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:20.735234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bdd1e-79c6-49d8-93aa-7ead6078527c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:20.797802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f12b7-6718-4242-ba82-ef9bb14258b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:20.798513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f12b7-6718-4242-ba82-ef9bb14258b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.798797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f12b7-6718-4242-ba82-ef9bb14258b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.799140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f12b7-6718-4242-ba82-ef9bb14258b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.799842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f12b7-6718-4242-ba82-ef9bb14258b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:20.801839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f12b7-6718-4242-ba82-ef9bb14258b8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:20.902969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 872/1748] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:20 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:20.907606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef76d71-658d-45a0-ba2a-ac4ce0d37263 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:20.917685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef76d71-658d-45a0-ba2a-ac4ce0d37263 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:20.922857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93dd7-4c98-4fbf-a2f2-b632dbf90b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:20.923938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93dd7-4c98-4fbf-a2f2-b632dbf90b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.923938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93dd7-4c98-4fbf-a2f2-b632dbf90b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.924114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93dd7-4c98-4fbf-a2f2-b632dbf90b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.927315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93dd7-4c98-4fbf-a2f2-b632dbf90b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:20.927315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93dd7-4c98-4fbf-a2f2-b632dbf90b4e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:20.940572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 877/1749] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:20.944883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f12b7-6718-4242-ba82-ef9bb14258b8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:20.955470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f12b7-6718-4242-ba82-ef9bb14258b8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:20.960147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833c17-46f6-497d-b9b3-39c06dd8107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:20.961018 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833c17-46f6-497d-b9b3-39c06dd8107b admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:20.961306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833c17-46f6-497d-b9b3-39c06dd8107b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:20.961623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833c17-46f6-497d-b9b3-39c06dd8107b admin admin] PATH_INFO: `/v3/projects/e24fdb3f9f1242188df116c39cfc7eab/users/71564fa7929c4864aac217d70c5eb310/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:20.978935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61833c17-46f6-497d-b9b3-39c06dd8107b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24fdb3f9f1242188df116c39cfc7eab, user_id=71564fa7929c4864aac217d70c5eb310, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:20.981587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61833c17-46f6-497d-b9b3-39c06dd8107b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:21.043248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 873/1750] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:20 2022] PUT /identity/v3/projects/e24fdb3f9f1242188df116c39cfc7eab/users/71564fa7929c4864aac217d70c5eb310/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:21.044808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93dd7-4c98-4fbf-a2f2-b632dbf90b4e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:21.060512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93dd7-4c98-4fbf-a2f2-b632dbf90b4e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:21.083559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:21.120038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a529a7-4ae5-46b4-aec6-77bbcbb94b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:21.120694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a529a7-4ae5-46b4-aec6-77bbcbb94b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:21.120972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a529a7-4ae5-46b4-aec6-77bbcbb94b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:21.121244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a529a7-4ae5-46b4-aec6-77bbcbb94b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:21.121986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a529a7-4ae5-46b4-aec6-77bbcbb94b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:21.123629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a529a7-4ae5-46b4-aec6-77bbcbb94b98 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:21.133795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 878/1751] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:21.138092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833c17-46f6-497d-b9b3-39c06dd8107b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:21.143567 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:21.149082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833c17-46f6-497d-b9b3-39c06dd8107b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:21.153576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:21.154496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:21.154773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:21.156764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] PATH_INFO: `/v3/projects/e24fdb3f9f1242188df116c39cfc7eab/users/71564fa7929c4864aac217d70c5eb310/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:21.157650 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24fdb3f9f1242188df116c39cfc7eab, user_id=71564fa7929c4864aac217d70c5eb310, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:21.160316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:21.170369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 874/1752] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:21 2022] PUT /identity/v3/projects/e24fdb3f9f1242188df116c39cfc7eab/users/71564fa7929c4864aac217d70c5eb310/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:21.180663 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534db18-e450-46d7-b4fc-ad0fe229b3cb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:21.181025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534db18-e450-46d7-b4fc-ad0fe229b3cb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:21.181367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534db18-e450-46d7-b4fc-ad0fe229b3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:21.208961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9534db18-e450-46d7-b4fc-ad0fe229b3cb None None] MFA Rules not processed for user `71564fa7929c4864aac217d70c5eb310`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:21.210184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9534db18-e450-46d7-b4fc-ad0fe229b3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:21.280977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 879/1753] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:21.294732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:21.297157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:21.365193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24957cf7-ccc2-449b-a085-70f6e08e80b5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:21.368802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e951e-1e9c-467f-9901-c1ecf5ac209f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:21.369455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e951e-1e9c-467f-9901-c1ecf5ac209f service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:21.369732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e951e-1e9c-467f-9901-c1ecf5ac209f service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:21.370025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e951e-1e9c-467f-9901-c1ecf5ac209f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:21.380631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e951e-1e9c-467f-9901-c1ecf5ac209f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:21.382111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e951e-1e9c-467f-9901-c1ecf5ac209f service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:21.393512 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 875/1754] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:22.144736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534db18-e450-46d7-b4fc-ad0fe229b3cb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:22.205993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534db18-e450-46d7-b4fc-ad0fe229b3cb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:22.211025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:22.211917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:22.212196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:22.212467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] PATH_INFO: `/v3/users/d97b260d717e4b119eba1402ba1ad489` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:22.213673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97b260d717e4b119eba1402ba1ad489)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:22.215691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:22.442660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97b260d717e4b119eba1402ba1ad489'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:22.443305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97b260d717e4b119eba1402ba1ad489'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:22.444984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:22.576473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97b260d717e4b119eba1402ba1ad489'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:22.589896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97b260d717e4b119eba1402ba1ad489'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:22.596539 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97b260d717e4b119eba1402ba1ad489'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:22.602392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 880/1755] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:22 2022] DELETE /identity/v3/users/d97b260d717e4b119eba1402ba1ad489 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:22.606985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03bdd4-6b1f-42f0-94cc-6aca504e97ee None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:22.607562 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03bdd4-6b1f-42f0-94cc-6aca504e97ee None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:22.607718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03bdd4-6b1f-42f0-94cc-6aca504e97ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:22.626287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4e03bdd4-6b1f-42f0-94cc-6aca504e97ee None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:22.627593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4e03bdd4-6b1f-42f0-94cc-6aca504e97ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:22.695732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 876/1756] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:42:22.706737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:22.708143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:22.769788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe565a-0b49-44ce-a29c-9dc4c6af5d22 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:22.775986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04497ee4-5b58-4dd0-a126-5fdb150dee7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:22.776960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497ee4-5b58-4dd0-a126-5fdb150dee7e service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:22.777327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497ee4-5b58-4dd0-a126-5fdb150dee7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:22.777587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497ee4-5b58-4dd0-a126-5fdb150dee7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:22.787866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04497ee4-5b58-4dd0-a126-5fdb150dee7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:22.789328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04497ee4-5b58-4dd0-a126-5fdb150dee7e service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:22.802186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 881/1757] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:22.824705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03bdd4-6b1f-42f0-94cc-6aca504e97ee None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:22.826306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4e03bdd4-6b1f-42f0-94cc-6aca504e97ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:22.842317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03bdd4-6b1f-42f0-94cc-6aca504e97ee None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:22.851384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:22.851384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:22.851384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:22.851384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] PATH_INFO: `/v3/users/a9cf8e07eee644de8b6da0d1bd6969db` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:22.852800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cf8e07eee644de8b6da0d1bd6969db)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:22.855230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:23.098019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cf8e07eee644de8b6da0d1bd6969db'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.188851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cf8e07eee644de8b6da0d1bd6969db'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.201191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cf8e07eee644de8b6da0d1bd6969db'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.203315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cf8e07eee644de8b6da0d1bd6969db'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.250743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-26857b0b-8192-47e8-a6bd-07584a83510e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cf8e07eee644de8b6da0d1bd6969db'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.267745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 877/1758] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:22 2022] DELETE /identity/v3/users/a9cf8e07eee644de8b6da0d1bd6969db => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:23.272121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711960c-a3aa-4181-911c-207ec25caf0c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:23.272677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711960c-a3aa-4181-911c-207ec25caf0c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:23.272677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711960c-a3aa-4181-911c-207ec25caf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:23.309042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c97b1-8025-4ba1-b87f-3415004ce720 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:23.309324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c97b1-8025-4ba1-b87f-3415004ce720 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:23.309597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c97b1-8025-4ba1-b87f-3415004ce720 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:23.311010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 878/1759] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 22:42:23.312398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5711960c-a3aa-4181-911c-207ec25caf0c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:23.314055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5711960c-a3aa-4181-911c-207ec25caf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:23.320503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3bdd-af02-44e0-a87f-1eda0135077f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:23.320822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3bdd-af02-44e0-a87f-1eda0135077f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:23.321101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c3bdd-af02-44e0-a87f-1eda0135077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:23.337775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:23.360410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-943c3bdd-af02-44e0-a87f-1eda0135077f None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:23.362360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-943c3bdd-af02-44e0-a87f-1eda0135077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:23.425325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 882/1760] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:23.426319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711960c-a3aa-4181-911c-207ec25caf0c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:23.428648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5711960c-a3aa-4181-911c-207ec25caf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:23.449877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711960c-a3aa-4181-911c-207ec25caf0c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:23.458921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:23.462291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:23.462578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:23.462856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] PATH_INFO: `/v3/users/b95ca47ffefa486e881f7603d84352f4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:23.466413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95ca47ffefa486e881f7603d84352f4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:23.468395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:23.484655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 879/1761] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:42:23.488829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3bdd-af02-44e0-a87f-1eda0135077f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:23.488829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-943c3bdd-af02-44e0-a87f-1eda0135077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:23.564877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c3bdd-af02-44e0-a87f-1eda0135077f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:23.568558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:23.569207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:23.569483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:23.569758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:23.579392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:23.580811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:23.590564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 880/1762] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:23.591386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:23.595451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:23.610029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393f0db-26ee-48d8-9aa9-90f5573b9a14 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:23.615926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:23.616782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:23.617200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:23.617722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:23.628009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:23.629766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:23.641187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 881/1763] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:23.641991 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:23.643325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:23.657786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654a1d9-e34c-411b-9873-81280f515eb7 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:23.663766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:23.664742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:23.665156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:23.665496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] PATH_INFO: `/v3/projects/f7dd6ef4dc6e4d8b9c5021e4bda6b350` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:23.666969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7dd6ef4dc6e4d8b9c5021e4bda6b350)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:23.669173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:23.707332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95ca47ffefa486e881f7603d84352f4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.708528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95ca47ffefa486e881f7603d84352f4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.783172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95ca47ffefa486e881f7603d84352f4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.797750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:23.804273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7dd6ef4dc6e4d8b9c5021e4bda6b350', 'request_id': 'req-a1c59903-f369-4577-b817-585d9d003144'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.804492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95ca47ffefa486e881f7603d84352f4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.816640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-23b686eb-a670-4f88-8388-660098851733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95ca47ffefa486e881f7603d84352f4'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.825248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 883/1764] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:23 2022] DELETE /identity/v3/users/b95ca47ffefa486e881f7603d84352f4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:23.831686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929bb05-5c4d-49a0-9d59-65c7b948ba1d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:23.832385 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929bb05-5c4d-49a0-9d59-65c7b948ba1d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:23.832777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929bb05-5c4d-49a0-9d59-65c7b948ba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:23.861436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b929bb05-5c4d-49a0-9d59-65c7b948ba1d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:23.862849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b929bb05-5c4d-49a0-9d59-65c7b948ba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:23.942376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 884/1765] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:23.948386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7dd6ef4dc6e4d8b9c5021e4bda6b350', 'request_id': 'req-a1c59903-f369-4577-b817-585d9d003144'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.959480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929bb05-5c4d-49a0-9d59-65c7b948ba1d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:23.962242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7dd6ef4dc6e4d8b9c5021e4bda6b350', 'request_id': 'req-a1c59903-f369-4577-b817-585d9d003144'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.964496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b929bb05-5c4d-49a0-9d59-65c7b948ba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:23.978934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] The token cache is being invalidate because project f7dd6ef4dc6e4d8b9c5021e4bda6b350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:23.979544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.980491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:23.986728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 882/1766] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:23 2022] DELETE /identity/v3/projects/f7dd6ef4dc6e4d8b9c5021e4bda6b350 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:23.990837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:23.990837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:24.004256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:24.048266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929bb05-5c4d-49a0-9d59-65c7b948ba1d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:24.052380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:24.053240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.053520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.053798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.058092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:24.069842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:24.071312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:24.078813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59903-f369-4577-b817-585d9d003144 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:24.083317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 885/1767] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:24.084851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:24.085733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.086031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.086312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] PATH_INFO: `/v3/users/71564fa7929c4864aac217d70c5eb310` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.087644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71564fa7929c4864aac217d70c5eb310)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:24.089714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:24.104390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:24.105976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:24.125301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ece945-356b-49b0-8e31-a08d4b11b2a2 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:24.139116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:24.140270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.141353 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.141763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] PATH_INFO: `/v3/projects/f8bbc83e1a8e4aaab9f728bdfd58412f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.143578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8bbc83e1a8e4aaab9f728bdfd58412f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:24.145841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:24.340826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71564fa7929c4864aac217d70c5eb310'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.355355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8bbc83e1a8e4aaab9f728bdfd58412f', 'request_id': 'req-6036b2db-2488-4b82-83ed-f8200a26b321'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.388833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71564fa7929c4864aac217d70c5eb310'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.399034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71564fa7929c4864aac217d70c5eb310'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.399824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71564fa7929c4864aac217d70c5eb310'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.413476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-096e39b7-2ec3-4f67-88e3-af57fa1f772f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71564fa7929c4864aac217d70c5eb310'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.419812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 883/1768] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:23 2022] DELETE /identity/v3/users/71564fa7929c4864aac217d70c5eb310 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:24.454466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8bbc83e1a8e4aaab9f728bdfd58412f', 'request_id': 'req-6036b2db-2488-4b82-83ed-f8200a26b321'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.461896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8bbc83e1a8e4aaab9f728bdfd58412f', 'request_id': 'req-6036b2db-2488-4b82-83ed-f8200a26b321'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.477108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] The token cache is being invalidate because project f8bbc83e1a8e4aaab9f728bdfd58412f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:24.477487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.479845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-6036b2db-2488-4b82-83ed-f8200a26b321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.482138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 886/1769] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:24 2022] DELETE /identity/v3/projects/f8bbc83e1a8e4aaab9f728bdfd58412f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:24.488990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72be4-d070-484e-b611-d21050b576eb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.489873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72be4-d070-484e-b611-d21050b576eb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.490250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c72be4-d070-484e-b611-d21050b576eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.513084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b5c72be4-d070-484e-b611-d21050b576eb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:24.514981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b5c72be4-d070-484e-b611-d21050b576eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:24.580380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 884/1770] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:24.589293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699fbe8-18d0-4786-b640-4dc2b9ab324b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.589591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699fbe8-18d0-4786-b640-4dc2b9ab324b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.589848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699fbe8-18d0-4786-b640-4dc2b9ab324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.609514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9699fbe8-18d0-4786-b640-4dc2b9ab324b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:24.610828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9699fbe8-18d0-4786-b640-4dc2b9ab324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:24.619393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 887/1771] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:24.624609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72be4-d070-484e-b611-d21050b576eb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:24.634698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c72be4-d070-484e-b611-d21050b576eb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:24.640297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:24.648260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.648260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.648260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.648260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:42:24.648260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:24.648260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:24.662297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 885/1772] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:42:24.663910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699fbe8-18d0-4786-b640-4dc2b9ab324b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:24.675234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699fbe8-18d0-4786-b640-4dc2b9ab324b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:24.680845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea07e-7203-4e29-878b-a817449de160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:24.681501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea07e-7203-4e29-878b-a817449de160 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.681811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea07e-7203-4e29-878b-a817449de160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.682137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ea07e-7203-4e29-878b-a817449de160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.682871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea07e-7203-4e29-878b-a817449de160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:24.684985 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ea07e-7203-4e29-878b-a817449de160 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:24.725610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:24.727358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:24.740483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91d2e4-30dc-4c61-b90c-437fbec50f86 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:24.747719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:24.748608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.749443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.749906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] PATH_INFO: `/v3/projects/8233d910af2a405fa51316a93c119371` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.751504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8233d910af2a405fa51316a93c119371)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:24.753476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:24.813479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 888/1773] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:24.817496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea07e-7203-4e29-878b-a817449de160 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:24.878810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ea07e-7203-4e29-878b-a817449de160 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:24.879872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8233d910af2a405fa51316a93c119371', 'request_id': 'req-e0583f46-ae94-43d8-b990-b459df888d80'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:24.885801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:24.946365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:24.947038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:24.947584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:24.947763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:24.948424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:24.950364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:24.993853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8233d910af2a405fa51316a93c119371', 'request_id': 'req-e0583f46-ae94-43d8-b990-b459df888d80'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.000707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8233d910af2a405fa51316a93c119371', 'request_id': 'req-e0583f46-ae94-43d8-b990-b459df888d80'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.012099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] The token cache is being invalidate because project 8233d910af2a405fa51316a93c119371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:25.012386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.013032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.015273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 886/1774] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:24 2022] DELETE /identity/v3/projects/8233d910af2a405fa51316a93c119371 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:25.016032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.017288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:25.028522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 889/1775] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:24 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:25.029537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.030362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0583f46-ae94-43d8-b990-b459df888d80 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.031719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:25.035556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:25.036409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.036691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.037115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] PATH_INFO: `/v3/projects/e24fdb3f9f1242188df116c39cfc7eab` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.038593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24fdb3f9f1242188df116c39cfc7eab)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:25.040837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:25.043911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a9334-e3b9-4ec1-8777-6753654b1c82 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.049579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:25.050503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.050783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.051057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] PATH_INFO: `/v3/users/92a278a6f142414da1d35651ccce7d35` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.052277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92a278a6f142414da1d35651ccce7d35)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:25.054237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:25.205771 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:25.236582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24fdb3f9f1242188df116c39cfc7eab', 'request_id': 'req-0d090239-8a31-4797-a374-691e3781c54d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.236805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92a278a6f142414da1d35651ccce7d35'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.237483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92a278a6f142414da1d35651ccce7d35'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.297988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24fdb3f9f1242188df116c39cfc7eab', 'request_id': 'req-0d090239-8a31-4797-a374-691e3781c54d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.307021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24fdb3f9f1242188df116c39cfc7eab', 'request_id': 'req-0d090239-8a31-4797-a374-691e3781c54d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.322750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] The token cache is being invalidate because project e24fdb3f9f1242188df116c39cfc7eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:25.323041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.323750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.326093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 887/1776] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:25 2022] DELETE /identity/v3/projects/e24fdb3f9f1242188df116c39cfc7eab => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:25.326815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.328429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:25.393979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92a278a6f142414da1d35651ccce7d35'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.404229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d090239-8a31-4797-a374-691e3781c54d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.410730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555384b9-6b5f-4ac4-8b1f-61ac4eb0ae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:25.411269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92a278a6f142414da1d35651ccce7d35'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.419529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555384b9-6b5f-4ac4-8b1f-61ac4eb0ae5a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.419529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555384b9-6b5f-4ac4-8b1f-61ac4eb0ae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.419529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555384b9-6b5f-4ac4-8b1f-61ac4eb0ae5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.419529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555384b9-6b5f-4ac4-8b1f-61ac4eb0ae5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:25.419529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555384b9-6b5f-4ac4-8b1f-61ac4eb0ae5a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:25.420416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92a278a6f142414da1d35651ccce7d35'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:25.430559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 888/1778] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:25.430655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 890/1778] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:25 2022] DELETE /identity/v3/users/92a278a6f142414da1d35651ccce7d35 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:25.431253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.433018 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:25.436495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a2534-9971-4975-9d5c-ccaf8b7b592c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.436975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a2534-9971-4975-9d5c-ccaf8b7b592c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.436975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a2534-9971-4975-9d5c-ccaf8b7b592c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.488682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-012a2534-9971-4975-9d5c-ccaf8b7b592c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:25.490647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-012a2534-9971-4975-9d5c-ccaf8b7b592c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:25.537915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a670df-eb6a-4ad0-9d94-27cbc3606084 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.549955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb504aa-df2a-402c-9806-049cb2485619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:25.551101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb504aa-df2a-402c-9806-049cb2485619 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.551433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb504aa-df2a-402c-9806-049cb2485619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.551710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb504aa-df2a-402c-9806-049cb2485619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.552453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb504aa-df2a-402c-9806-049cb2485619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:25.554655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb504aa-df2a-402c-9806-049cb2485619 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:25.572254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 891/1779] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:42:25.577641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb504aa-df2a-402c-9806-049cb2485619 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.589628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb504aa-df2a-402c-9806-049cb2485619 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.595954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020fbb-68c2-4929-ba6c-23996a079310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:25.596852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020fbb-68c2-4929-ba6c-23996a079310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.597183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020fbb-68c2-4929-ba6c-23996a079310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.597468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020fbb-68c2-4929-ba6c-23996a079310 admin admin] PATH_INFO: `/v3/projects/0569ad9df320441fa0c9a6996ad39739/users/813e695e149d40cf89f2447214357851/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.617280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c020fbb-68c2-4929-ba6c-23996a079310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0569ad9df320441fa0c9a6996ad39739, user_id=813e695e149d40cf89f2447214357851, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:25.619093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 889/1780] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:25.620639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c020fbb-68c2-4929-ba6c-23996a079310 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:25.622727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dc6b1-5eab-4a96-aab6-74fc45d436cb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.623220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dc6b1-5eab-4a96-aab6-74fc45d436cb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.625073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170dc6b1-5eab-4a96-aab6-74fc45d436cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.647958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-170dc6b1-5eab-4a96-aab6-74fc45d436cb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:25.649174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-170dc6b1-5eab-4a96-aab6-74fc45d436cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:25.657988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 890/1781] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:25.662227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dc6b1-5eab-4a96-aab6-74fc45d436cb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.671917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170dc6b1-5eab-4a96-aab6-74fc45d436cb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.676795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:25.677432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.677772 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.678073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.678810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:42:25.679152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:25.680990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:25.693157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 891/1782] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:42:25.697559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.711159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f76ad-b6d6-45bb-999b-063775a3754f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.714293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 892/1783] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:25 2022] PUT /identity/v3/projects/0569ad9df320441fa0c9a6996ad39739/users/813e695e149d40cf89f2447214357851/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:25.729373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7c497-729b-42d6-8913-afffb4c48bf4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.729745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7c497-729b-42d6-8913-afffb4c48bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.730130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7c497-729b-42d6-8913-afffb4c48bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.767362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-59d7c497-729b-42d6-8913-afffb4c48bf4 None None] MFA Rules not processed for user `813e695e149d40cf89f2447214357851`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:25.768942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-59d7c497-729b-42d6-8913-afffb4c48bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:25.779709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46411-7589-4a1a-933a-a070481f6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:25.780926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46411-7589-4a1a-933a-a070481f6a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.781278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46411-7589-4a1a-933a-a070481f6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.781563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf46411-7589-4a1a-933a-a070481f6a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.782598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf46411-7589-4a1a-933a-a070481f6a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:25.784883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf46411-7589-4a1a-933a-a070481f6a81 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:25.836954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 893/1784] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:42:25.841126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7c497-729b-42d6-8913-afffb4c48bf4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.852039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7c497-729b-42d6-8913-afffb4c48bf4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.856636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177330a7-9baa-4129-b576-6a0166f2fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:25.857284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177330a7-9baa-4129-b576-6a0166f2fb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:25.857560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177330a7-9baa-4129-b576-6a0166f2fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:25.857839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177330a7-9baa-4129-b576-6a0166f2fb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:25.859361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177330a7-9baa-4129-b576-6a0166f2fb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:25.861478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177330a7-9baa-4129-b576-6a0166f2fb42 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:25.876513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 892/1785] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:25 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:25.880549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46411-7589-4a1a-933a-a070481f6a81 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:25.942270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 894/1786] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:25 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:25.943543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf46411-7589-4a1a-933a-a070481f6a81 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:25.943685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177330a7-9baa-4129-b576-6a0166f2fb42 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.007044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.007719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.008023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.008299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.008988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.010990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.027053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177330a7-9baa-4129-b576-6a0166f2fb42 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.032045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee2dcc-dc11-4696-91ec-042cc1f5756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.032845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee2dcc-dc11-4696-91ec-042cc1f5756b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.033229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee2dcc-dc11-4696-91ec-042cc1f5756b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.033504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee2dcc-dc11-4696-91ec-042cc1f5756b admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.034224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee2dcc-dc11-4696-91ec-042cc1f5756b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.036259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee2dcc-dc11-4696-91ec-042cc1f5756b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.102702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 893/1787] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:25 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:26.103531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.105070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.117033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8c2a1-0e31-43c9-8223-bf6feb4ff762 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.121861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.122720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.122996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.123262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] PATH_INFO: `/v3/projects/c0007fa8bc2b4b86a1ab522ee9c28e94` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.125196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0007fa8bc2b4b86a1ab522ee9c28e94)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.127735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.137166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 895/1788] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:25 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:26.137986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee2dcc-dc11-4696-91ec-042cc1f5756b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.147698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee2dcc-dc11-4696-91ec-042cc1f5756b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.152301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9fbde-714a-40bd-9988-7efab6e43067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.152946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9fbde-714a-40bd-9988-7efab6e43067 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.153220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9fbde-714a-40bd-9988-7efab6e43067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.153490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9fbde-714a-40bd-9988-7efab6e43067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.154227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9fbde-714a-40bd-9988-7efab6e43067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.156483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9fbde-714a-40bd-9988-7efab6e43067 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.166213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 896/1789] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:26.170124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9fbde-714a-40bd-9988-7efab6e43067 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.176771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9fbde-714a-40bd-9988-7efab6e43067 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.181576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be0a8a-6a7a-4ab9-bc84-ebf8550c0549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.182218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0a8a-6a7a-4ab9-bc84-ebf8550c0549 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.182496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0a8a-6a7a-4ab9-bc84-ebf8550c0549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.182765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0a8a-6a7a-4ab9-bc84-ebf8550c0549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.183455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0a8a-6a7a-4ab9-bc84-ebf8550c0549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.184978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0a8a-6a7a-4ab9-bc84-ebf8550c0549 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.198742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 897/1790] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:26.198742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be0a8a-6a7a-4ab9-bc84-ebf8550c0549 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.204583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be0a8a-6a7a-4ab9-bc84-ebf8550c0549 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.209062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af01a5-a28e-4296-ae01-9ba5d16d92ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.209671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af01a5-a28e-4296-ae01-9ba5d16d92ad admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.209951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af01a5-a28e-4296-ae01-9ba5d16d92ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.210262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af01a5-a28e-4296-ae01-9ba5d16d92ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.210964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af01a5-a28e-4296-ae01-9ba5d16d92ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.212769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af01a5-a28e-4296-ae01-9ba5d16d92ad admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.223739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 898/1791] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:26.224515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af01a5-a28e-4296-ae01-9ba5d16d92ad admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.236061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af01a5-a28e-4296-ae01-9ba5d16d92ad admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.238896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0007fa8bc2b4b86a1ab522ee9c28e94', 'request_id': 'req-02cb4256-8681-4c1f-801d-8b9df255ea8b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:26.289694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da798d5f-2676-428a-a988-9b9c77b62bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.290613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da798d5f-2676-428a-a988-9b9c77b62bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.290893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da798d5f-2676-428a-a988-9b9c77b62bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.291166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da798d5f-2676-428a-a988-9b9c77b62bc6 admin admin] PATH_INFO: `/v3/projects/1ea1d318d220413f887035aa37ba74d9/users/9626c5d399954943a5ea5216f4c9de5e/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.305583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da798d5f-2676-428a-a988-9b9c77b62bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea1d318d220413f887035aa37ba74d9, user_id=9626c5d399954943a5ea5216f4c9de5e, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.308294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da798d5f-2676-428a-a988-9b9c77b62bc6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.312072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:26.336440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0007fa8bc2b4b86a1ab522ee9c28e94', 'request_id': 'req-02cb4256-8681-4c1f-801d-8b9df255ea8b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:26.342499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0007fa8bc2b4b86a1ab522ee9c28e94', 'request_id': 'req-02cb4256-8681-4c1f-801d-8b9df255ea8b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:26.354991 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] The token cache is being invalidate because project c0007fa8bc2b4b86a1ab522ee9c28e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:26.355276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:26.355926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:26.357462 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 894/1792] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:26 2022] DELETE /identity/v3/projects/c0007fa8bc2b4b86a1ab522ee9c28e94 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:26.358896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.360640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.372978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb4256-8681-4c1f-801d-8b9df255ea8b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.377938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0a811-b610-4267-a49f-b5a77da8c67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.386726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0a811-b610-4267-a49f-b5a77da8c67a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.386726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0a811-b610-4267-a49f-b5a77da8c67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.386726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0a811-b610-4267-a49f-b5a77da8c67a admin admin] PATH_INFO: `/v3/projects/a295aa576973467d9a23b2d8c4e58c20/users/989d641a14ff477ab6ea14acf1b5284e/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.394125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0a811-b610-4267-a49f-b5a77da8c67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a295aa576973467d9a23b2d8c4e58c20, user_id=989d641a14ff477ab6ea14acf1b5284e, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.396756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0a811-b610-4267-a49f-b5a77da8c67a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.411854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 899/1793] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:26 2022] PUT /identity/v3/projects/1ea1d318d220413f887035aa37ba74d9/users/9626c5d399954943a5ea5216f4c9de5e/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:26.413334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6185312-bfc1-4067-b998-bd8b666ba8ea None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.413618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6185312-bfc1-4067-b998-bd8b666ba8ea None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.413920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6185312-bfc1-4067-b998-bd8b666ba8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.432143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f6185312-bfc1-4067-b998-bd8b666ba8ea None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:26.433382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f6185312-bfc1-4067-b998-bd8b666ba8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.492154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 900/1794] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:26.493065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6185312-bfc1-4067-b998-bd8b666ba8ea None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.494484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f6185312-bfc1-4067-b998-bd8b666ba8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.501498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 895/1795] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:26 2022] PUT /identity/v3/projects/a295aa576973467d9a23b2d8c4e58c20/users/989d641a14ff477ab6ea14acf1b5284e/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:26.502891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b91448-026e-4050-9e9e-112c81a9d072 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.503244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b91448-026e-4050-9e9e-112c81a9d072 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.503592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b91448-026e-4050-9e9e-112c81a9d072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.506904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6185312-bfc1-4067-b998-bd8b666ba8ea None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.527458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-78b91448-026e-4050-9e9e-112c81a9d072 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:26.528907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-78b91448-026e-4050-9e9e-112c81a9d072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.568688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b006f-34f8-41b3-bbf5-3924a854a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.569445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b006f-34f8-41b3-bbf5-3924a854a302 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.569859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b006f-34f8-41b3-bbf5-3924a854a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.570081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b006f-34f8-41b3-bbf5-3924a854a302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.570816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b006f-34f8-41b3-bbf5-3924a854a302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.579069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b006f-34f8-41b3-bbf5-3924a854a302 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.591052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 896/1796] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:26.596099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65a7c-60fa-453e-9465-dc1617bf88e3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.596617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65a7c-60fa-453e-9465-dc1617bf88e3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.596966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65a7c-60fa-453e-9465-dc1617bf88e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.601863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:26.605461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 901/1797] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:26.606339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b006f-34f8-41b3-bbf5-3924a854a302 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.620579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b006f-34f8-41b3-bbf5-3924a854a302 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.626925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.627586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.628276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.628276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.628883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:42:26.636419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.636419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.636613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-75a65a7c-60fa-453e-9465-dc1617bf88e3 None None] MFA Rules not processed for user `989d641a14ff477ab6ea14acf1b5284e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:26.636613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-75a65a7c-60fa-453e-9465-dc1617bf88e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.651566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 902/1798] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:42:26.651566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.661926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c043c-7d5f-415f-9a85-e3492b71cb34 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.667732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cee938-e247-4495-b03c-357af30fbf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.668619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cee938-e247-4495-b03c-357af30fbf1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.668897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cee938-e247-4495-b03c-357af30fbf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.669166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cee938-e247-4495-b03c-357af30fbf1d admin admin] PATH_INFO: `/v3/projects/1ea1d318d220413f887035aa37ba74d9/users/9626c5d399954943a5ea5216f4c9de5e/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.671991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cee938-e247-4495-b03c-357af30fbf1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea1d318d220413f887035aa37ba74d9, user_id=9626c5d399954943a5ea5216f4c9de5e, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.675364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cee938-e247-4495-b03c-357af30fbf1d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.702446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 903/1799] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:26 2022] PUT /identity/v3/projects/1ea1d318d220413f887035aa37ba74d9/users/9626c5d399954943a5ea5216f4c9de5e/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:26.702446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cee938-e247-4495-b03c-357af30fbf1d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.711218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 897/1800] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:26.712571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ebd0b-4b0c-4625-8e62-9b50b184df67 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.712804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ebd0b-4b0c-4625-8e62-9b50b184df67 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.713082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ebd0b-4b0c-4625-8e62-9b50b184df67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.740249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c59ebd0b-4b0c-4625-8e62-9b50b184df67 None None] MFA Rules not processed for user `9626c5d399954943a5ea5216f4c9de5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:26.741502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c59ebd0b-4b0c-4625-8e62-9b50b184df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.785330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cee938-e247-4495-b03c-357af30fbf1d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.790090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.790755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.791033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.791304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.792013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:26.794107 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:26.831358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 898/1801] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:26.832385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ebd0b-4b0c-4625-8e62-9b50b184df67 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.834531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c59ebd0b-4b0c-4625-8e62-9b50b184df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.882728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 904/1802] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:26 2022] POST /identity/v3/projects => generated 355 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:26.883803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:26.887268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:26.898703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ebd0b-4b0c-4625-8e62-9b50b184df67 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.947008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:26.954849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14466-9061-4125-9f25-2e4e8f7cdd36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.955499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14466-9061-4125-9f25-2e4e8f7cdd36 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.955779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14466-9061-4125-9f25-2e4e8f7cdd36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.956052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14466-9061-4125-9f25-2e4e8f7cdd36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.958444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb381f17-ea43-4712-a166-72b0115911b0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:26.961971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a6a07-7b4d-4bce-9dde-8ec5c00988a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:26.962640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6a07-7b4d-4bce-9dde-8ec5c00988a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:26.962916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6a07-7b4d-4bce-9dde-8ec5c00988a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:26.963185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a6a07-7b4d-4bce-9dde-8ec5c00988a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:26.966802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:27.015723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14466-9061-4125-9f25-2e4e8f7cdd36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.017068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14466-9061-4125-9f25-2e4e8f7cdd36 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.024350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a6a07-7b4d-4bce-9dde-8ec5c00988a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.025807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a6a07-7b4d-4bce-9dde-8ec5c00988a7 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.027116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 899/1803] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:27.027727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14466-9061-4125-9f25-2e4e8f7cdd36 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:27.035641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 905/1804] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:27.052195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:27.054239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a6a07-7b4d-4bce-9dde-8ec5c00988a7 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:27.080584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:27.101364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14466-9061-4125-9f25-2e4e8f7cdd36 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:27.105937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12906f6-5193-4f90-b77e-b0a78c571970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:27.106609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12906f6-5193-4f90-b77e-b0a78c571970 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.106883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12906f6-5193-4f90-b77e-b0a78c571970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.107151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12906f6-5193-4f90-b77e-b0a78c571970 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.107828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12906f6-5193-4f90-b77e-b0a78c571970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.109935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12906f6-5193-4f90-b77e-b0a78c571970 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.121395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a6a07-7b4d-4bce-9dde-8ec5c00988a7 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:27.126729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:27.127597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.127874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.128145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] PATH_INFO: `/v3/users/989d641a14ff477ab6ea14acf1b5284e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.129341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989d641a14ff477ab6ea14acf1b5284e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.131286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.189171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 900/1805] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:27 2022] POST /identity/v3/users => generated 278 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:27.193313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12906f6-5193-4f90-b77e-b0a78c571970 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:27.204152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12906f6-5193-4f90-b77e-b0a78c571970 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:27.208865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678728-056b-41ce-804f-0a4c8eadddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:27.209505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678728-056b-41ce-804f-0a4c8eadddc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.209816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678728-056b-41ce-804f-0a4c8eadddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.210129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678728-056b-41ce-804f-0a4c8eadddc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.210901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9678728-056b-41ce-804f-0a4c8eadddc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.212483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9678728-056b-41ce-804f-0a4c8eadddc6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.222785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 901/1806] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:27.226663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678728-056b-41ce-804f-0a4c8eadddc6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:27.236191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678728-056b-41ce-804f-0a4c8eadddc6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:27.240718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399a5e1-eb2d-485f-a220-40f0a0a4072d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:27.241329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399a5e1-eb2d-485f-a220-40f0a0a4072d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.241610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399a5e1-eb2d-485f-a220-40f0a0a4072d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.241883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399a5e1-eb2d-485f-a220-40f0a0a4072d admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.242614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399a5e1-eb2d-485f-a220-40f0a0a4072d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.244151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399a5e1-eb2d-485f-a220-40f0a0a4072d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.254975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 902/1807] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:42:27.258913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399a5e1-eb2d-485f-a220-40f0a0a4072d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:27.269127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399a5e1-eb2d-485f-a220-40f0a0a4072d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:27.273634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ac993-944a-4c82-9aa0-0c62a469bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:27.274509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac993-944a-4c82-9aa0-0c62a469bf1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.274788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac993-944a-4c82-9aa0-0c62a469bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.275058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ac993-944a-4c82-9aa0-0c62a469bf1d admin admin] PATH_INFO: `/v3/projects/6fdfeb6f48b049429b125bad66e7aa6f/users/0bf55d6b2f7a42f5b6d0a95b83c65660/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.290576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ac993-944a-4c82-9aa0-0c62a469bf1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdfeb6f48b049429b125bad66e7aa6f, user_id=0bf55d6b2f7a42f5b6d0a95b83c65660, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.293691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ac993-944a-4c82-9aa0-0c62a469bf1d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.354607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989d641a14ff477ab6ea14acf1b5284e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:27.355260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989d641a14ff477ab6ea14acf1b5284e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:27.388344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:27.394354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 903/1808] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:27 2022] PUT /identity/v3/projects/6fdfeb6f48b049429b125bad66e7aa6f/users/0bf55d6b2f7a42f5b6d0a95b83c65660/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:27.404389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f896c-8940-473b-a0ce-e1fd5815b607 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.404677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f896c-8940-473b-a0ce-e1fd5815b607 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.404977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f896c-8940-473b-a0ce-e1fd5815b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.423574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989d641a14ff477ab6ea14acf1b5284e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:27.441036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989d641a14ff477ab6ea14acf1b5284e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:27.446229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6d7f896c-8940-473b-a0ce-e1fd5815b607 None None] MFA Rules not processed for user `0bf55d6b2f7a42f5b6d0a95b83c65660`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:27.448004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d7f896c-8940-473b-a0ce-e1fd5815b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:27.449295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5f9041a9-9b17-496a-bf4c-ae753f16e2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989d641a14ff477ab6ea14acf1b5284e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:27.456039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 906/1809] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:27 2022] DELETE /identity/v3/users/989d641a14ff477ab6ea14acf1b5284e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:27.460455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc890-33b8-4138-814b-3be5b174f779 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.460959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc890-33b8-4138-814b-3be5b174f779 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.461746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccc890-33b8-4138-814b-3be5b174f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.482574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2eccc890-33b8-4138-814b-3be5b174f779 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:27.485016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2eccc890-33b8-4138-814b-3be5b174f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:27.521797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 904/1810] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:27 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:42:27.525948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f896c-8940-473b-a0ce-e1fd5815b607 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:27.527275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d7f896c-8940-473b-a0ce-e1fd5815b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:27.552897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 907/1811] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:27.562900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccc890-33b8-4138-814b-3be5b174f779 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:27.564380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2eccc890-33b8-4138-814b-3be5b174f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:27.601550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f896c-8940-473b-a0ce-e1fd5815b607 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:27.606989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:27.610417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4869-80e5-4004-b15d-d4ed07ecdc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:27.611188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4869-80e5-4004-b15d-d4ed07ecdc7b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.611567 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4869-80e5-4004-b15d-d4ed07ecdc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.611935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4869-80e5-4004-b15d-d4ed07ecdc7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.613130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e4869-80e5-4004-b15d-d4ed07ecdc7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.615335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e4869-80e5-4004-b15d-d4ed07ecdc7b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.631513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccc890-33b8-4138-814b-3be5b174f779 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:27.635367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2ba2d-5687-41a6-83b2-e22a6eddc80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:27.636023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2ba2d-5687-41a6-83b2-e22a6eddc80d service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.636299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2ba2d-5687-41a6-83b2-e22a6eddc80d service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.636570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2ba2d-5687-41a6-83b2-e22a6eddc80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.647113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2ba2d-5687-41a6-83b2-e22a6eddc80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.648550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2ba2d-5687-41a6-83b2-e22a6eddc80d service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:27.658702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 908/1812] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:42:27.674647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:27.720969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 905/1813] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:27 2022] POST /identity/v3/projects => generated 357 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:27.722705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2ba2d-5687-41a6-83b2-e22a6eddc80d service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:27.736586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2ba2d-5687-41a6-83b2-e22a6eddc80d service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:27.742090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:27.808208 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6332-d412-428b-b95a-a9f7c9fef646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:27.808849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6332-d412-428b-b95a-a9f7c9fef646 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:27.809127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6332-d412-428b-b95a-a9f7c9fef646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:27.809399 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6332-d412-428b-b95a-a9f7c9fef646 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:27.810119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a6332-d412-428b-b95a-a9f7c9fef646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:27.812616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a6332-d412-428b-b95a-a9f7c9fef646 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:28.213469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 909/1814] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:27 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:28.216504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4869-80e5-4004-b15d-d4ed07ecdc7b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:28.216504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4869-80e5-4004-b15d-d4ed07ecdc7b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:28.216504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:28.216504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.217577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.217577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.217577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:28.217577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:28.223368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 906/1815] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:28.227492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6332-d412-428b-b95a-a9f7c9fef646 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:28.238715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6332-d412-428b-b95a-a9f7c9fef646 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:28.243204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663913-2353-4b25-9084-1fa77e69b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:28.244085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663913-2353-4b25-9084-1fa77e69b518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.244369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663913-2353-4b25-9084-1fa77e69b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.244640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663913-2353-4b25-9084-1fa77e69b518 admin admin] PATH_INFO: `/v3/projects/bac600a0d0434eeba9ae2d0451bffe8e/users/c1f5cecd063c4925a0addb424c84a716/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.260116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1663913-2353-4b25-9084-1fa77e69b518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac600a0d0434eeba9ae2d0451bffe8e, user_id=c1f5cecd063c4925a0addb424c84a716, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:28.262797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1663913-2353-4b25-9084-1fa77e69b518 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:28.391304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:28.393552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:28.408673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c23a88-ef33-4a1a-b3ea-d5e9ed9006af admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:28.414877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:28.415237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.415713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.415994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] PATH_INFO: `/v3/projects/a295aa576973467d9a23b2d8c4e58c20` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.417278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a295aa576973467d9a23b2d8c4e58c20)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:28.419195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:28.440781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 910/1816] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:28 2022] PUT /identity/v3/projects/bac600a0d0434eeba9ae2d0451bffe8e/users/c1f5cecd063c4925a0addb424c84a716/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:28.444745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663913-2353-4b25-9084-1fa77e69b518 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:28.507252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1663913-2353-4b25-9084-1fa77e69b518 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:28.512000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:28.512819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.513211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.513491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.514236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:28.518974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:28.526467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 911/1817] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:42:28.527273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:28.528955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:28.542273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ddcda-97c8-4685-a9e1-02ea23ed927c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:28.550314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a295aa576973467d9a23b2d8c4e58c20', 'request_id': 'req-bca95c6c-4c93-40af-9053-6e06ce429001'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.597167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:28.598097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.598374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.598647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] PATH_INFO: `/v3/users/813e695e149d40cf89f2447214357851` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.599810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=813e695e149d40cf89f2447214357851)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:28.601707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:28.662211 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a295aa576973467d9a23b2d8c4e58c20', 'request_id': 'req-bca95c6c-4c93-40af-9053-6e06ce429001'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.668161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a295aa576973467d9a23b2d8c4e58c20', 'request_id': 'req-bca95c6c-4c93-40af-9053-6e06ce429001'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.680394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] The token cache is being invalidate because project a295aa576973467d9a23b2d8c4e58c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:28.680660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.681296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.682942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 907/1818] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:28 2022] DELETE /identity/v3/projects/a295aa576973467d9a23b2d8c4e58c20 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:28.683678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:28.684941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:28.697436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca95c6c-4c93-40af-9053-6e06ce429001 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:28.702229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ac78e-a8c1-44be-8365-bae284196668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:28.703103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ac78e-a8c1-44be-8365-bae284196668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.703379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ac78e-a8c1-44be-8365-bae284196668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.703646 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ac78e-a8c1-44be-8365-bae284196668 admin admin] PATH_INFO: `/v3/projects/bac600a0d0434eeba9ae2d0451bffe8e/users/c1f5cecd063c4925a0addb424c84a716/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.705618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ac78e-a8c1-44be-8365-bae284196668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac600a0d0434eeba9ae2d0451bffe8e, user_id=c1f5cecd063c4925a0addb424c84a716, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:28.708258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ac78e-a8c1-44be-8365-bae284196668 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:28.719082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 908/1819] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:28 2022] PUT /identity/v3/projects/bac600a0d0434eeba9ae2d0451bffe8e/users/c1f5cecd063c4925a0addb424c84a716/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:28.720153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28087b83-f8f8-40e6-b804-1f634cdca86d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.720378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28087b83-f8f8-40e6-b804-1f634cdca86d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.720656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28087b83-f8f8-40e6-b804-1f634cdca86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.740098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-28087b83-f8f8-40e6-b804-1f634cdca86d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:28.741474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-28087b83-f8f8-40e6-b804-1f634cdca86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:28.758679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:28.783992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813e695e149d40cf89f2447214357851'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.784713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813e695e149d40cf89f2447214357851'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.800935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 909/1820] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:28.807329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163cd9-6f80-4b9e-9f87-1f620b60f800 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.807329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163cd9-6f80-4b9e-9f87-1f620b60f800 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.807329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163cd9-6f80-4b9e-9f87-1f620b60f800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.828596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-10163cd9-6f80-4b9e-9f87-1f620b60f800 None None] MFA Rules not processed for user `c1f5cecd063c4925a0addb424c84a716`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:28.829786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-10163cd9-6f80-4b9e-9f87-1f620b60f800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:28.839096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813e695e149d40cf89f2447214357851'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.851924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813e695e149d40cf89f2447214357851'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.859611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fc676310-779c-4eeb-9ffa-cab33bbc53c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813e695e149d40cf89f2447214357851'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:28.865525 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 912/1821] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:28 2022] DELETE /identity/v3/users/813e695e149d40cf89f2447214357851 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:28.869595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141b4c-505e-4139-bf1d-c109c4299566 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.873543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141b4c-505e-4139-bf1d-c109c4299566 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.873543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66141b4c-505e-4139-bf1d-c109c4299566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.888785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-66141b4c-505e-4139-bf1d-c109c4299566 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:28.891269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-66141b4c-505e-4139-bf1d-c109c4299566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:28.892819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:28.899124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 910/1822] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:28 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:28.903886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2a6a-ade1-4266-87a6-224b628e98b4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:28.904177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2a6a-ade1-4266-87a6-224b628e98b4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:28.904506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2a6a-ade1-4266-87a6-224b628e98b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:28.924847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-783f2a6a-ade1-4266-87a6-224b628e98b4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:28.926080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-783f2a6a-ade1-4266-87a6-224b628e98b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:28.954234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 913/1823] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:28.955084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141b4c-505e-4139-bf1d-c109c4299566 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:28.958486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-66141b4c-505e-4139-bf1d-c109c4299566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:28.987438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 911/1824] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:28.988485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2a6a-ade1-4266-87a6-224b628e98b4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:28.998237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2a6a-ade1-4266-87a6-224b628e98b4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.010039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.010039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.010039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.010039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.010429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:42:29.010429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.010429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.018835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 912/1825] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:42:29.019739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.021642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:29.022651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66141b4c-505e-4139-bf1d-c109c4299566 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.026246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f5091-f1ec-42cf-ab07-49ff192ac1bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.026885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5091-f1ec-42cf-ab07-49ff192ac1bb service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.027164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5091-f1ec-42cf-ab07-49ff192ac1bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.027558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5091-f1ec-42cf-ab07-49ff192ac1bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.089634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2589d10-54d6-464f-adda-5eadff9f0f30 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.093478 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e390-daf5-40cb-b7ba-7d1b0ba1b386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.094164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e390-daf5-40cb-b7ba-7d1b0ba1b386 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.094446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e390-daf5-40cb-b7ba-7d1b0ba1b386 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.094725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e390-daf5-40cb-b7ba-7d1b0ba1b386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.097127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f5091-f1ec-42cf-ab07-49ff192ac1bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.098595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f5091-f1ec-42cf-ab07-49ff192ac1bb service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.104192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e390-daf5-40cb-b7ba-7d1b0ba1b386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.105680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e390-daf5-40cb-b7ba-7d1b0ba1b386 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.108087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 914/1826] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:28 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:29.109382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f5091-f1ec-42cf-ab07-49ff192ac1bb service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.119575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 913/1827] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:29.120484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f5091-f1ec-42cf-ab07-49ff192ac1bb service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.124929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c499866-0958-459e-9fde-2fd3294ad7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.125822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499866-0958-459e-9fde-2fd3294ad7da admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.126298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499866-0958-459e-9fde-2fd3294ad7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.126729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499866-0958-459e-9fde-2fd3294ad7da admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.127565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c499866-0958-459e-9fde-2fd3294ad7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.129467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c499866-0958-459e-9fde-2fd3294ad7da admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.198651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 915/1828] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:29 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:29.203112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e390-daf5-40cb-b7ba-7d1b0ba1b386 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.221697 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e390-daf5-40cb-b7ba-7d1b0ba1b386 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.290318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6ee2d-e143-4ebd-a031-1433c0f58763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.291073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ee2d-e143-4ebd-a031-1433c0f58763 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.291286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ee2d-e143-4ebd-a031-1433c0f58763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.291494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ee2d-e143-4ebd-a031-1433c0f58763 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.292230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6ee2d-e143-4ebd-a031-1433c0f58763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.294201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6ee2d-e143-4ebd-a031-1433c0f58763 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.322315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c499866-0958-459e-9fde-2fd3294ad7da admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.376649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:29.396801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c499866-0958-459e-9fde-2fd3294ad7da admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.401038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.401688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.401980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.402415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.411557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:29.413340 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 914/1829] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:29 2022] POST /identity/v3/users => generated 289 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:29.417513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:29.419176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6ee2d-e143-4ebd-a031-1433c0f58763 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.431337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6ee2d-e143-4ebd-a031-1433c0f58763 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.437483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f36458-4b60-457a-acb6-16d474777136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.438230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f36458-4b60-457a-acb6-16d474777136 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.438513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f36458-4b60-457a-acb6-16d474777136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.438783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f36458-4b60-457a-acb6-16d474777136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.440698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f36458-4b60-457a-acb6-16d474777136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.443652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f36458-4b60-457a-acb6-16d474777136 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.466073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 915/1830] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:29.468141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f36458-4b60-457a-acb6-16d474777136 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.498347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f36458-4b60-457a-acb6-16d474777136 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.504199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ca5a9-1ec9-4c35-88e8-9e0b8fb36820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.509233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ca5a9-1ec9-4c35-88e8-9e0b8fb36820 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.509233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ca5a9-1ec9-4c35-88e8-9e0b8fb36820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.509233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ca5a9-1ec9-4c35-88e8-9e0b8fb36820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.509233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ca5a9-1ec9-4c35-88e8-9e0b8fb36820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.511611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ca5a9-1ec9-4c35-88e8-9e0b8fb36820 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.525148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 916/1831] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:29.529044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.529689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ca5a9-1ec9-4c35-88e8-9e0b8fb36820 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.531638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.541885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 916/1832] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:29 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:29.542314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ca5a9-1ec9-4c35-88e8-9e0b8fb36820 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.557736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2116bb-9022-4823-8c02-930386278c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.557736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2116bb-9022-4823-8c02-930386278c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.557736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2116bb-9022-4823-8c02-930386278c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.557736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2116bb-9022-4823-8c02-930386278c9a admin admin] PATH_INFO: `/v3/projects/2f534944e9114271906c0c88f97dd477/users/1a3a656c9e334b0a98afd3a8698d4cfa/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.571901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2116bb-9022-4823-8c02-930386278c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f534944e9114271906c0c88f97dd477, user_id=1a3a656c9e334b0a98afd3a8698d4cfa, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.574711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2116bb-9022-4823-8c02-930386278c9a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.664577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.665967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:29.686114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458228a7-6ebe-4037-b475-6d4a2a3806eb service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:29.694516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 917/1833] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:29 2022] PUT /identity/v3/projects/2f534944e9114271906c0c88f97dd477/users/1a3a656c9e334b0a98afd3a8698d4cfa/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:29.703099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6090c-6877-445b-9b7b-a60ccb715fd7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.703375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6090c-6877-445b-9b7b-a60ccb715fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.703625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6090c-6877-445b-9b7b-a60ccb715fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.732226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-64d6090c-6877-445b-9b7b-a60ccb715fd7 None None] MFA Rules not processed for user `1a3a656c9e334b0a98afd3a8698d4cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:29.733439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-64d6090c-6877-445b-9b7b-a60ccb715fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:29.748218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:29.749665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:29.749952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:29.750627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] PATH_INFO: `/v3/projects/0569ad9df320441fa0c9a6996ad39739` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:29.751572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0569ad9df320441fa0c9a6996ad39739)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:29.753759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:29.809702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 918/1834] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:42:29.856955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0569ad9df320441fa0c9a6996ad39739', 'request_id': 'req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:29.930886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0569ad9df320441fa0c9a6996ad39739', 'request_id': 'req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:29.938449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0569ad9df320441fa0c9a6996ad39739', 'request_id': 'req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:29.951070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] The token cache is being invalidate because project 0569ad9df320441fa0c9a6996ad39739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:29.951438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:29.953368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:29.955124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6090c-6877-445b-9b7b-a60ccb715fd7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.955437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 917/1835] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:29 2022] DELETE /identity/v3/projects/0569ad9df320441fa0c9a6996ad39739 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:29.959283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:29.960612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:29.972343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:30.016264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6090c-6877-445b-9b7b-a60ccb715fd7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:30.031657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3ea9-6e32-46f6-a9f8-701ced42b7e6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:30.036572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:30.037397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:30.037797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:30.037938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] PATH_INFO: `/v3/users/9626c5d399954943a5ea5216f4c9de5e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:30.041980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9626c5d399954943a5ea5216f4c9de5e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:30.044065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:30.084191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:30.084841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:30.085121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:30.085418 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:30.088383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:30.147918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:30.149357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:30.159952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 919/1836] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:42:30.221588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9626c5d399954943a5ea5216f4c9de5e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:30.222715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9626c5d399954943a5ea5216f4c9de5e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:30.325304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9626c5d399954943a5ea5216f4c9de5e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:30.339048 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9626c5d399954943a5ea5216f4c9de5e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:30.346605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-118986a4-1b47-4f62-b6f9-2c3e7b8b5394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9626c5d399954943a5ea5216f4c9de5e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:30.352581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 918/1837] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:29 2022] DELETE /identity/v3/users/9626c5d399954943a5ea5216f4c9de5e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:30.411164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:30.846833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:30.900379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a11806-b93a-4ed2-9383-bdca9ea22267 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:31.002733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:31.004073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.005821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.006134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] PATH_INFO: `/v3/projects/1ea1d318d220413f887035aa37ba74d9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.018986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea1d318d220413f887035aa37ba74d9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:31.020946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:31.154692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea1d318d220413f887035aa37ba74d9', 'request_id': 'req-24136292-776e-4c9b-abad-6f08951e302c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:31.194253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:31.223527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea1d318d220413f887035aa37ba74d9', 'request_id': 'req-24136292-776e-4c9b-abad-6f08951e302c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:31.233820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea1d318d220413f887035aa37ba74d9', 'request_id': 'req-24136292-776e-4c9b-abad-6f08951e302c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:31.247143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] The token cache is being invalidate because project 1ea1d318d220413f887035aa37ba74d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:31.247430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:31.248399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-24136292-776e-4c9b-abad-6f08951e302c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:31.251265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 920/1838] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:30 2022] DELETE /identity/v3/projects/1ea1d318d220413f887035aa37ba74d9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:31.257096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0d8ba-ac9e-4736-8974-3948adb0b253 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.257096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0d8ba-ac9e-4736-8974-3948adb0b253 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.257096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0d8ba-ac9e-4736-8974-3948adb0b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.275550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4aa0d8ba-ac9e-4736-8974-3948adb0b253 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:31.276733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4aa0d8ba-ac9e-4736-8974-3948adb0b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:31.342235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 919/1839] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:31.344259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935b94-f391-4b67-8c4b-46606201c10e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.344613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935b94-f391-4b67-8c4b-46606201c10e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.345038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6935b94-f391-4b67-8c4b-46606201c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.377092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f6935b94-f391-4b67-8c4b-46606201c10e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:31.378586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f6935b94-f391-4b67-8c4b-46606201c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:31.390815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 921/1840] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:31.391912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0d8ba-ac9e-4736-8974-3948adb0b253 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:31.404665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0d8ba-ac9e-4736-8974-3948adb0b253 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:31.412251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:31.413212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.413495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.413850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.415116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:42:31.415430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:31.417338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:31.437599 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 920/1841] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:42:31.448710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6935b94-f391-4b67-8c4b-46606201c10e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:31.452936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6935b94-f391-4b67-8c4b-46606201c10e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:31.458516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c809ce9-07a9-4eb2-bed1-f554d12939a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:31.459252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c809ce9-07a9-4eb2-bed1-f554d12939a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.459602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c809ce9-07a9-4eb2-bed1-f554d12939a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.460363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c809ce9-07a9-4eb2-bed1-f554d12939a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.471249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c809ce9-07a9-4eb2-bed1-f554d12939a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:31.473485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c809ce9-07a9-4eb2-bed1-f554d12939a9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:31.596964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 922/1842] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:31 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:31.600956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:31.613936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2712-6448-489a-ba4b-b1ecfadabaea admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:31.667820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fcc79-f286-415a-b7a8-eb28ed22a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:31.668487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fcc79-f286-415a-b7a8-eb28ed22a08d admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.668766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fcc79-f286-415a-b7a8-eb28ed22a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.669042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fcc79-f286-415a-b7a8-eb28ed22a08d admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.669816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fcc79-f286-415a-b7a8-eb28ed22a08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:31.671934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fcc79-f286-415a-b7a8-eb28ed22a08d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:31.749835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:31.785869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 921/1843] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:31 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:31.787804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c809ce9-07a9-4eb2-bed1-f554d12939a9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:31.808995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c809ce9-07a9-4eb2-bed1-f554d12939a9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:31.814823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6df92-40b0-4588-b933-1b671cc8b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:31.815498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6df92-40b0-4588-b933-1b671cc8b8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.815784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6df92-40b0-4588-b933-1b671cc8b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.816056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6df92-40b0-4588-b933-1b671cc8b8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.816790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6df92-40b0-4588-b933-1b671cc8b8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:31.818419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6df92-40b0-4588-b933-1b671cc8b8a9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:31.829692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 923/1844] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:31.834869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fcc79-f286-415a-b7a8-eb28ed22a08d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:31.848978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fcc79-f286-415a-b7a8-eb28ed22a08d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:31.851120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e6594-7a0f-4647-8659-e3b272174367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:31.851778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e6594-7a0f-4647-8659-e3b272174367 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.852053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e6594-7a0f-4647-8659-e3b272174367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.852325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e6594-7a0f-4647-8659-e3b272174367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.853565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e6594-7a0f-4647-8659-e3b272174367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:31.855319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e6594-7a0f-4647-8659-e3b272174367 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:31.866744 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 922/1845] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:31.871999 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6df92-40b0-4588-b933-1b671cc8b8a9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:31.882742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6df92-40b0-4588-b933-1b671cc8b8a9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:31.887875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d1a8c-91f1-4052-b099-323414e23a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:31.888804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1a8c-91f1-4052-b099-323414e23a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:31.889273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1a8c-91f1-4052-b099-323414e23a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:31.890148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d1a8c-91f1-4052-b099-323414e23a32 admin admin] PATH_INFO: `/v3/projects/25f4ed68f63d4e388e8ca0b850836463/users/1134e1fe0b53418696017b89168f1fd6/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:31.905013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d1a8c-91f1-4052-b099-323414e23a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f4ed68f63d4e388e8ca0b850836463, user_id=1134e1fe0b53418696017b89168f1fd6, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:31.908314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d1a8c-91f1-4052-b099-323414e23a32 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:31.991949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 924/1846] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:31 2022] PUT /identity/v3/projects/25f4ed68f63d4e388e8ca0b850836463/users/1134e1fe0b53418696017b89168f1fd6/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:32.002028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06796d1-ca73-4af6-9661-6c6c49eedebc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:32.002323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06796d1-ca73-4af6-9661-6c6c49eedebc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:32.002603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06796d1-ca73-4af6-9661-6c6c49eedebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:32.028462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c06796d1-ca73-4af6-9661-6c6c49eedebc None None] MFA Rules not processed for user `1134e1fe0b53418696017b89168f1fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:32.029651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c06796d1-ca73-4af6-9661-6c6c49eedebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:32.107362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 923/1847] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:32.112858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d1a8c-91f1-4052-b099-323414e23a32 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:32.192115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d1a8c-91f1-4052-b099-323414e23a32 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:32.198789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7981-876a-43a0-a22f-6837af8a0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:32.199455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7981-876a-43a0-a22f-6837af8a0cea admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:32.203307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7981-876a-43a0-a22f-6837af8a0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:32.203307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f7981-876a-43a0-a22f-6837af8a0cea admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:32.203307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f7981-876a-43a0-a22f-6837af8a0cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:32.203549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f7981-876a-43a0-a22f-6837af8a0cea admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:32.310677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 925/1848] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:42:32 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:42:32.315332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06796d1-ca73-4af6-9661-6c6c49eedebc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:32.325689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06796d1-ca73-4af6-9661-6c6c49eedebc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:32.381841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d179-b0f3-44cc-9e34-f5f04dd7d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:32.382530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d179-b0f3-44cc-9e34-f5f04dd7d329 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:32.382805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d179-b0f3-44cc-9e34-f5f04dd7d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:32.383071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d179-b0f3-44cc-9e34-f5f04dd7d329 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:32.383752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401d179-b0f3-44cc-9e34-f5f04dd7d329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:32.385705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401d179-b0f3-44cc-9e34-f5f04dd7d329 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:32.491123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 924/1849] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:42:32 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:42:32.495101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7981-876a-43a0-a22f-6837af8a0cea admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:32.505605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f7981-876a-43a0-a22f-6837af8a0cea admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:32.510354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89278199-ad76-4118-9bc7-08366059a582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:32.510998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278199-ad76-4118-9bc7-08366059a582 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:32.511278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278199-ad76-4118-9bc7-08366059a582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:32.511551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89278199-ad76-4118-9bc7-08366059a582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:32.513402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89278199-ad76-4118-9bc7-08366059a582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:32.515601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89278199-ad76-4118-9bc7-08366059a582 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:32.526526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 926/1850] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:42:32.530982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d179-b0f3-44cc-9e34-f5f04dd7d329 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:32.541172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d179-b0f3-44cc-9e34-f5f04dd7d329 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:32.546569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0150-80df-4450-8630-89626fae603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:32.547515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0150-80df-4450-8630-89626fae603c admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:32.547790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0150-80df-4450-8630-89626fae603c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:32.548059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc0150-80df-4450-8630-89626fae603c admin admin] PATH_INFO: `/v3/projects/536c593e00ea4225a0e279dd09954f54/users/90c5a0c3daa0401781ef1a345a9078ae/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:32.564873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0150-80df-4450-8630-89626fae603c admin admin] RBAC: Authorizing `identity:create_grant(project_id=536c593e00ea4225a0e279dd09954f54, user_id=90c5a0c3daa0401781ef1a345a9078ae, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:32.569468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc0150-80df-4450-8630-89626fae603c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:32.685968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 925/1851] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:32 2022] PUT /identity/v3/projects/536c593e00ea4225a0e279dd09954f54/users/90c5a0c3daa0401781ef1a345a9078ae/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:42:32.690960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89278199-ad76-4118-9bc7-08366059a582 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:32.701907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89278199-ad76-4118-9bc7-08366059a582 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:32.721007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:32.766158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea2723-74da-4915-b5b2-1ddef4b52626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:32.767459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2723-74da-4915-b5b2-1ddef4b52626 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:32.767459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2723-74da-4915-b5b2-1ddef4b52626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:32.768001 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2723-74da-4915-b5b2-1ddef4b52626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:32.768580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2723-74da-4915-b5b2-1ddef4b52626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:32.770430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2723-74da-4915-b5b2-1ddef4b52626 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:32.782121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 927/1852] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:42:32.786420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0150-80df-4450-8630-89626fae603c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:32.797573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc0150-80df-4450-8630-89626fae603c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:32.817236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:32.818172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:32.819270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:32.819270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] PATH_INFO: `/v3/projects/536c593e00ea4225a0e279dd09954f54/users/90c5a0c3daa0401781ef1a345a9078ae/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:32.820758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536c593e00ea4225a0e279dd09954f54, user_id=90c5a0c3daa0401781ef1a345a9078ae, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:32.823427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:32.834928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 926/1853] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:42:32 2022] PUT /identity/v3/projects/536c593e00ea4225a0e279dd09954f54/users/90c5a0c3daa0401781ef1a345a9078ae/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:32.846814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8120f-996f-4a67-b395-fb7b66ad8804 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:32.847102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8120f-996f-4a67-b395-fb7b66ad8804 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:32.847404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8120f-996f-4a67-b395-fb7b66ad8804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:32.877723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d7c8120f-996f-4a67-b395-fb7b66ad8804 None None] MFA Rules not processed for user `90c5a0c3daa0401781ef1a345a9078ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:32.879034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d7c8120f-996f-4a67-b395-fb7b66ad8804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:32.960516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 928/1854] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:33.041872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:33.044102 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:33.107883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f8df-449a-4eca-8ef4-b74abbadd875 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:33.112409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:33.119578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:33.119578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:33.119578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:33.123679 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:33.125109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:33.134982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 927/1855] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:33.341689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:33.544382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8120f-996f-4a67-b395-fb7b66ad8804 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:33.553864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8120f-996f-4a67-b395-fb7b66ad8804 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:33.557805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ec9d7-38e2-4a85-a821-e03e661a4428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:33.561707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec9d7-38e2-4a85-a821-e03e661a4428 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:33.561707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec9d7-38e2-4a85-a821-e03e661a4428 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:33.561707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ec9d7-38e2-4a85-a821-e03e661a4428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:33.614834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ec9d7-38e2-4a85-a821-e03e661a4428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:33.616260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ec9d7-38e2-4a85-a821-e03e661a4428 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:33.626164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 929/1856] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:34.913776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:44.445368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=81 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:45.199046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=10 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:58.086595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:58.088638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:58.154343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39dd98-eda4-42ee-a117-c369c1d12ef6 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:58.158941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:58.159813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:58.160091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:58.160363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] PATH_INFO: `/v3/users/ab2882c84e454d5789f5c76f49998525` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:58.161666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2882c84e454d5789f5c76f49998525)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:58.163708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:58.391546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2882c84e454d5789f5c76f49998525'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:58.392291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2882c84e454d5789f5c76f49998525'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:58.461524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2882c84e454d5789f5c76f49998525'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:58.473559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2882c84e454d5789f5c76f49998525'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:58.480326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2882c84e454d5789f5c76f49998525'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:58.486925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 928/1857] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:58 2022] DELETE /identity/v3/users/ab2882c84e454d5789f5c76f49998525 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:58.491472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dfeb4-2da7-406c-9c66-f1b88eedb120 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:58.491980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dfeb4-2da7-406c-9c66-f1b88eedb120 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:58.492073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dfeb4-2da7-406c-9c66-f1b88eedb120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:58.510903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0a6dfeb4-2da7-406c-9c66-f1b88eedb120 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:42:58.512234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0a6dfeb4-2da7-406c-9c66-f1b88eedb120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:58.584458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 930/1858] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:42:58.594181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:58.595653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:58.670331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb855d-7001-4812-a517-8086a4c58be5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:58.673564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd512da-4e2c-4d3e-9d08-45717cf835a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:58.674359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd512da-4e2c-4d3e-9d08-45717cf835a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:58.674616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd512da-4e2c-4d3e-9d08-45717cf835a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:58.674958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd512da-4e2c-4d3e-9d08-45717cf835a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:58.685772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd512da-4e2c-4d3e-9d08-45717cf835a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:58.687293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd512da-4e2c-4d3e-9d08-45717cf835a4 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:58.698293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 929/1859] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:42:59.092307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dfeb4-2da7-406c-9c66-f1b88eedb120 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:59.093779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0a6dfeb4-2da7-406c-9c66-f1b88eedb120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:42:59.106819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dfeb4-2da7-406c-9c66-f1b88eedb120 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:59.112158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:59.113021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:59.113300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:59.113569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] PATH_INFO: `/v3/projects/8bf9ae3e5a5641be99023d5899ce228c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:59.114843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf9ae3e5a5641be99023d5899ce228c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:59.116737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:59.319616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf9ae3e5a5641be99023d5899ce228c', 'request_id': 'req-f88d9615-369b-4df5-a3a7-c51792206190'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.364402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf9ae3e5a5641be99023d5899ce228c', 'request_id': 'req-f88d9615-369b-4df5-a3a7-c51792206190'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.379941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf9ae3e5a5641be99023d5899ce228c', 'request_id': 'req-f88d9615-369b-4df5-a3a7-c51792206190'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.382067 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] The token cache is being invalidate because project 8bf9ae3e5a5641be99023d5899ce228c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:42:59.382359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.383016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.384779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 931/1860] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:42:59 2022] DELETE /identity/v3/projects/8bf9ae3e5a5641be99023d5899ce228c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:42:59.388621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd512da-4e2c-4d3e-9d08-45717cf835a4 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:42:59.399696 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd512da-4e2c-4d3e-9d08-45717cf835a4 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:42:59.419349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:59.459407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:42:59.460282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:42:59.460561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:42:59.460833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] PATH_INFO: `/v3/users/b5fa40d875e04becb472e743935fb80f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:42:59.462085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5fa40d875e04becb472e743935fb80f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:42:59.464158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:42:59.693879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5fa40d875e04becb472e743935fb80f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.694574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5fa40d875e04becb472e743935fb80f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.776055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5fa40d875e04becb472e743935fb80f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.789100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5fa40d875e04becb472e743935fb80f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.796311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4da7ed41-6c1f-45b5-8e48-41f6a9264253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5fa40d875e04becb472e743935fb80f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:42:59.802821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 930/1861] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:42:59 2022] DELETE /identity/v3/users/b5fa40d875e04becb472e743935fb80f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:00.206475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:00.210472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:00.221498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d9615-369b-4df5-a3a7-c51792206190 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:00.279584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:00.280440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:00.280718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:00.280989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] PATH_INFO: `/v3/projects/91e5dec2a9514844aac1d6276d3b0a6e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:00.282411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e5dec2a9514844aac1d6276d3b0a6e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:00.284476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:00.400074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:00.416481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e5dec2a9514844aac1d6276d3b0a6e', 'request_id': 'req-4b42339c-e06f-4097-be7a-144b93029386'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:00.519076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e5dec2a9514844aac1d6276d3b0a6e', 'request_id': 'req-4b42339c-e06f-4097-be7a-144b93029386'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:00.525842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e5dec2a9514844aac1d6276d3b0a6e', 'request_id': 'req-4b42339c-e06f-4097-be7a-144b93029386'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:00.538206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] The token cache is being invalidate because project 91e5dec2a9514844aac1d6276d3b0a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:00.538489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:00.539145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4b42339c-e06f-4097-be7a-144b93029386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:00.540805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 932/1862] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:00 2022] DELETE /identity/v3/projects/91e5dec2a9514844aac1d6276d3b0a6e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:00.545825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a133ef-92d3-44c2-9069-de5c5c511a01 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:00.547429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a133ef-92d3-44c2-9069-de5c5c511a01 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:00.547429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a133ef-92d3-44c2-9069-de5c5c511a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:00.565300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d4a133ef-92d3-44c2-9069-de5c5c511a01 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:00.566525 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d4a133ef-92d3-44c2-9069-de5c5c511a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:00.624680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 931/1863] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:00.633105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7758cad-0c47-4013-a0e4-0935a5a51758 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:00.633412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7758cad-0c47-4013-a0e4-0935a5a51758 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:00.633691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7758cad-0c47-4013-a0e4-0935a5a51758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:00.652810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c7758cad-0c47-4013-a0e4-0935a5a51758 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:00.654090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c7758cad-0c47-4013-a0e4-0935a5a51758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:00.663409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 933/1864] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:00.667766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a133ef-92d3-44c2-9069-de5c5c511a01 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:00.677501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a133ef-92d3-44c2-9069-de5c5c511a01 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:00.682510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:00.683168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:00.683451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:00.683729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:00.684459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:00.684764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:00.686386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:00.698834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 932/1865] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:00.702898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7758cad-0c47-4013-a0e4-0935a5a51758 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:00.712465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7758cad-0c47-4013-a0e4-0935a5a51758 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:00.717087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184f429-6aab-4f32-8e25-05a1890a62c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:00.717773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184f429-6aab-4f32-8e25-05a1890a62c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:00.718154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184f429-6aab-4f32-8e25-05a1890a62c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:00.718429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184f429-6aab-4f32-8e25-05a1890a62c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:00.719115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184f429-6aab-4f32-8e25-05a1890a62c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:00.721643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184f429-6aab-4f32-8e25-05a1890a62c9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:00.798203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 934/1866] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:00 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:00.800710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:00.809747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6ee09-169a-402f-8569-a4f9b9c2a7b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:00.836559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:00.868708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a98498-a1a4-466f-ab6d-f5d14c1f54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:00.869361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a98498-a1a4-466f-ab6d-f5d14c1f54ed admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:00.869695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a98498-a1a4-466f-ab6d-f5d14c1f54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:00.869967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a98498-a1a4-466f-ab6d-f5d14c1f54ed admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:00.870683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a98498-a1a4-466f-ab6d-f5d14c1f54ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:00.872637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a98498-a1a4-466f-ab6d-f5d14c1f54ed admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:00.964384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 933/1867] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:00 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:00.965208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184f429-6aab-4f32-8e25-05a1890a62c9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:00.977766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184f429-6aab-4f32-8e25-05a1890a62c9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:00.982506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d0ea9-0837-4788-97d4-31468440aae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:00.983165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d0ea9-0837-4788-97d4-31468440aae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:00.983442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d0ea9-0837-4788-97d4-31468440aae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:00.983710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d0ea9-0837-4788-97d4-31468440aae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:00.984686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d0ea9-0837-4788-97d4-31468440aae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:00.986299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d0ea9-0837-4788-97d4-31468440aae8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:00.997025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 935/1868] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:01.002092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a98498-a1a4-466f-ab6d-f5d14c1f54ed admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.011876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a98498-a1a4-466f-ab6d-f5d14c1f54ed admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:01.017093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d17224-e512-47a7-bd21-9566f4b64689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:01.017756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17224-e512-47a7-bd21-9566f4b64689 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.018058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17224-e512-47a7-bd21-9566f4b64689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.018330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d17224-e512-47a7-bd21-9566f4b64689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.019047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d17224-e512-47a7-bd21-9566f4b64689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:01.020639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d17224-e512-47a7-bd21-9566f4b64689 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:01.030716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 934/1869] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:01.035238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d0ea9-0837-4788-97d4-31468440aae8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.045986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d0ea9-0837-4788-97d4-31468440aae8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:01.057333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b176a-f8a3-4156-96b7-714a82a380c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:01.057333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b176a-f8a3-4156-96b7-714a82a380c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.065337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b176a-f8a3-4156-96b7-714a82a380c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.066136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b176a-f8a3-4156-96b7-714a82a380c1 admin admin] PATH_INFO: `/v3/projects/ba8771de16af47ab918724e9a502585f/users/a30d2b3b847444a7af5ee63e26b76371/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.082689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b176a-f8a3-4156-96b7-714a82a380c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8771de16af47ab918724e9a502585f, user_id=a30d2b3b847444a7af5ee63e26b76371, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:01.085326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b176a-f8a3-4156-96b7-714a82a380c1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:01.158882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 936/1870] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:01 2022] PUT /identity/v3/projects/ba8771de16af47ab918724e9a502585f/users/a30d2b3b847444a7af5ee63e26b76371/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:01.169755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b17250-42d2-438e-8766-bbc932090db8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.170072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b17250-42d2-438e-8766-bbc932090db8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.170352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b17250-42d2-438e-8766-bbc932090db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.197838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-76b17250-42d2-438e-8766-bbc932090db8 None None] MFA Rules not processed for user `a30d2b3b847444a7af5ee63e26b76371`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:01.199082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-76b17250-42d2-438e-8766-bbc932090db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:01.263163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 935/1871] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:01.268520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b176a-f8a3-4156-96b7-714a82a380c1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.328500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b176a-f8a3-4156-96b7-714a82a380c1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:01.333829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd017e5-0362-4a57-94df-785c9d790c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:01.334509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd017e5-0362-4a57-94df-785c9d790c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.334792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd017e5-0362-4a57-94df-785c9d790c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.335060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd017e5-0362-4a57-94df-785c9d790c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.335733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd017e5-0362-4a57-94df-785c9d790c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:01.337604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd017e5-0362-4a57-94df-785c9d790c71 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:01.417137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 937/1872] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:01 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:01.421116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b17250-42d2-438e-8766-bbc932090db8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.433103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b17250-42d2-438e-8766-bbc932090db8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:01.490549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bad56d-1a1f-434e-926b-ee8b54c3807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:01.491229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bad56d-1a1f-434e-926b-ee8b54c3807c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.491507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bad56d-1a1f-434e-926b-ee8b54c3807c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.491776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bad56d-1a1f-434e-926b-ee8b54c3807c admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.492450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bad56d-1a1f-434e-926b-ee8b54c3807c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:01.494400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bad56d-1a1f-434e-926b-ee8b54c3807c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:01.564904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 936/1873] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:01 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:01.568878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd017e5-0362-4a57-94df-785c9d790c71 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.579551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd017e5-0362-4a57-94df-785c9d790c71 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:01.584159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fbbed-bd13-49c3-9b77-5706c85c0ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:01.584807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbbed-bd13-49c3-9b77-5706c85c0ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.585089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbbed-bd13-49c3-9b77-5706c85c0ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.585363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fbbed-bd13-49c3-9b77-5706c85c0ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.586216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fbbed-bd13-49c3-9b77-5706c85c0ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:01.587794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fbbed-bd13-49c3-9b77-5706c85c0ef0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:01.599447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 938/1874] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:01.603807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bad56d-1a1f-434e-926b-ee8b54c3807c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.614412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bad56d-1a1f-434e-926b-ee8b54c3807c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:01.618925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923b80-635e-49d4-b931-87a15ecca3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:01.619784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923b80-635e-49d4-b931-87a15ecca3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.620065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923b80-635e-49d4-b931-87a15ecca3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.620332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923b80-635e-49d4-b931-87a15ecca3c0 admin admin] PATH_INFO: `/v3/projects/91dc6a430485497090037abf036d2722/users/e4b4e74d2ba849d6ab9f35dde3db180d/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.635427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923b80-635e-49d4-b931-87a15ecca3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dc6a430485497090037abf036d2722, user_id=e4b4e74d2ba849d6ab9f35dde3db180d, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:01.638076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923b80-635e-49d4-b931-87a15ecca3c0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:01.701894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 937/1875] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:01 2022] PUT /identity/v3/projects/91dc6a430485497090037abf036d2722/users/e4b4e74d2ba849d6ab9f35dde3db180d/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:01.706256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fbbed-bd13-49c3-9b77-5706c85c0ef0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.716189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fbbed-bd13-49c3-9b77-5706c85c0ef0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:01.739988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:01.780180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39f394-415a-4969-b1ea-77d7c2528eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:01.780850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f394-415a-4969-b1ea-77d7c2528eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.781132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f394-415a-4969-b1ea-77d7c2528eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.781404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39f394-415a-4969-b1ea-77d7c2528eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.783000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39f394-415a-4969-b1ea-77d7c2528eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:01.784288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39f394-415a-4969-b1ea-77d7c2528eb4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:01.794629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 939/1876] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:01.799562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923b80-635e-49d4-b931-87a15ecca3c0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.805368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:01.810708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923b80-635e-49d4-b931-87a15ecca3c0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:01.815761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:01.816636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.817897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.817897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] PATH_INFO: `/v3/projects/91dc6a430485497090037abf036d2722/users/e4b4e74d2ba849d6ab9f35dde3db180d/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.819286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dc6a430485497090037abf036d2722, user_id=e4b4e74d2ba849d6ab9f35dde3db180d, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:01.822098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:01.832938 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 938/1877] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:01 2022] PUT /identity/v3/projects/91dc6a430485497090037abf036d2722/users/e4b4e74d2ba849d6ab9f35dde3db180d/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:01.843075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8fb3-5824-4589-90ac-9227be0dc864 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:01.843400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8fb3-5824-4589-90ac-9227be0dc864 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:01.843676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8fb3-5824-4589-90ac-9227be0dc864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:01.872187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-925e8fb3-5824-4589-90ac-9227be0dc864 None None] MFA Rules not processed for user `e4b4e74d2ba849d6ab9f35dde3db180d`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:01.873444 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-925e8fb3-5824-4589-90ac-9227be0dc864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:01.941909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 940/1878] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:01.953251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:01.954967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:02.017673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff72f7-b523-4a63-aeeb-6d76378b7d8f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:02.021292 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd1fb-0865-4c34-b351-4347b10eccd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:02.021927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd1fb-0865-4c34-b351-4347b10eccd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:02.022241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd1fb-0865-4c34-b351-4347b10eccd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:02.022517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dd1fb-0865-4c34-b351-4347b10eccd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:02.031383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dd1fb-0865-4c34-b351-4347b10eccd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:02.033425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dd1fb-0865-4c34-b351-4347b10eccd2 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:02.042983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 939/1879] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:02.142865 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8fb3-5824-4589-90ac-9227be0dc864 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:02.153903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8fb3-5824-4589-90ac-9227be0dc864 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:02.158109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e8333-123a-40e0-b05b-83dd7e8853d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:02.158749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e8333-123a-40e0-b05b-83dd7e8853d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:02.159026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e8333-123a-40e0-b05b-83dd7e8853d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:02.159294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e8333-123a-40e0-b05b-83dd7e8853d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:02.218244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e8333-123a-40e0-b05b-83dd7e8853d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:02.220170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e8333-123a-40e0-b05b-83dd7e8853d3 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:02.230152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 941/1880] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:08.138874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd1fb-0865-4c34-b351-4347b10eccd2 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:08.207398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dd1fb-0865-4c34-b351-4347b10eccd2 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:08.212397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:08.213406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:08.213742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:08.213957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] PATH_INFO: `/v3/users/a30d2b3b847444a7af5ee63e26b76371` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:08.215237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30d2b3b847444a7af5ee63e26b76371)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:08.217228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:08.386862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30d2b3b847444a7af5ee63e26b76371'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:08.387581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30d2b3b847444a7af5ee63e26b76371'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:08.484926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30d2b3b847444a7af5ee63e26b76371'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:08.509277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30d2b3b847444a7af5ee63e26b76371'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:08.525702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30d2b3b847444a7af5ee63e26b76371'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:08.541450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 940/1881] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:08 2022] DELETE /identity/v3/users/a30d2b3b847444a7af5ee63e26b76371 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:08.546155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04d207-6f63-4430-88a8-1aa74d3fd1f3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:08.546711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04d207-6f63-4430-88a8-1aa74d3fd1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:08.546711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04d207-6f63-4430-88a8-1aa74d3fd1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:08.577536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ec04d207-6f63-4430-88a8-1aa74d3fd1f3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:08.578944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ec04d207-6f63-4430-88a8-1aa74d3fd1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:08.636727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:08.674479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 942/1882] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:08.682056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:08.683778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:08.720335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:08.774633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85e280-b172-41f1-b308-9ba7d70a1432 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:08.778752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2cfee-a73c-4ff4-a0fc-862af9c0b507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:08.779568 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2cfee-a73c-4ff4-a0fc-862af9c0b507 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:08.780071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2cfee-a73c-4ff4-a0fc-862af9c0b507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:08.780516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2cfee-a73c-4ff4-a0fc-862af9c0b507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:08.792411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2cfee-a73c-4ff4-a0fc-862af9c0b507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:08.793935 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2cfee-a73c-4ff4-a0fc-862af9c0b507 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:08.805749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 941/1883] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:09.476202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04d207-6f63-4430-88a8-1aa74d3fd1f3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:09.477923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ec04d207-6f63-4430-88a8-1aa74d3fd1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:09.491929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04d207-6f63-4430-88a8-1aa74d3fd1f3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:09.497098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:09.498203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:09.498557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:09.498898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] PATH_INFO: `/v3/projects/ba8771de16af47ab918724e9a502585f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:09.500226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8771de16af47ab918724e9a502585f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:09.502525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:09.639555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8771de16af47ab918724e9a502585f', 'request_id': 'req-3547fdc1-1e0a-4878-986e-306fe95d564f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:09.702158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8771de16af47ab918724e9a502585f', 'request_id': 'req-3547fdc1-1e0a-4878-986e-306fe95d564f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:09.711248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8771de16af47ab918724e9a502585f', 'request_id': 'req-3547fdc1-1e0a-4878-986e-306fe95d564f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:09.754328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] The token cache is being invalidate because project ba8771de16af47ab918724e9a502585f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:09.755495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:09.756246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:09.758144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 943/1884] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:09 2022] DELETE /identity/v3/projects/ba8771de16af47ab918724e9a502585f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:09.769520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2cfee-a73c-4ff4-a0fc-862af9c0b507 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:09.821888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2cfee-a73c-4ff4-a0fc-862af9c0b507 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:09.909090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:09.910301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:09.910583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:09.910856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] PATH_INFO: `/v3/users/e4b4e74d2ba849d6ab9f35dde3db180d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:09.916129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b4e74d2ba849d6ab9f35dde3db180d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:09.918481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:10.082909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b4e74d2ba849d6ab9f35dde3db180d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.083742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b4e74d2ba849d6ab9f35dde3db180d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.130488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b4e74d2ba849d6ab9f35dde3db180d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.148362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b4e74d2ba849d6ab9f35dde3db180d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.155915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-154ded8d-ef34-4992-912b-c465fa5ce6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b4e74d2ba849d6ab9f35dde3db180d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.164541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 942/1885] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:09 2022] DELETE /identity/v3/users/e4b4e74d2ba849d6ab9f35dde3db180d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:10.572213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:10.573655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:10.623199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547fdc1-1e0a-4878-986e-306fe95d564f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:10.681310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:10.682216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:10.682498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:10.682773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] PATH_INFO: `/v3/projects/91dc6a430485497090037abf036d2722` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:10.683966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91dc6a430485497090037abf036d2722)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:10.685878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:10.765983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:10.784845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91dc6a430485497090037abf036d2722', 'request_id': 'req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.863058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91dc6a430485497090037abf036d2722', 'request_id': 'req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.868956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91dc6a430485497090037abf036d2722', 'request_id': 'req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.880115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] The token cache is being invalidate because project 91dc6a430485497090037abf036d2722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:10.880341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.880964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fa6fabac-7fca-4932-bbf0-c5ed3a7f7dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:10.882557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 944/1886] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:10 2022] DELETE /identity/v3/projects/91dc6a430485497090037abf036d2722 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:10.887661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0ee5e-700b-489e-9b51-6b4a185f119b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:10.888155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0ee5e-700b-489e-9b51-6b4a185f119b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:10.890101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0ee5e-700b-489e-9b51-6b4a185f119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:10.906702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a2f0ee5e-700b-489e-9b51-6b4a185f119b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:10.908997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a2f0ee5e-700b-489e-9b51-6b4a185f119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:10.912808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:10.967298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 943/1887] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:10.976214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75aed5-fe27-4859-871b-3dcc0dbf0bee None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:10.976502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75aed5-fe27-4859-871b-3dcc0dbf0bee None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:10.976781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75aed5-fe27-4859-871b-3dcc0dbf0bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:10.996097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6f75aed5-fe27-4859-871b-3dcc0dbf0bee None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:10.997345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6f75aed5-fe27-4859-871b-3dcc0dbf0bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:11.005830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 945/1888] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:11.010023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0ee5e-700b-489e-9b51-6b4a185f119b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:11.019919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0ee5e-700b-489e-9b51-6b4a185f119b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:11.024595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:11.025243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:11.025524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:11.025821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:11.026560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:11.026870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:11.028457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:11.040690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 944/1889] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:11.045211 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75aed5-fe27-4859-871b-3dcc0dbf0bee None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:11.056265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75aed5-fe27-4859-871b-3dcc0dbf0bee None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:11.061237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e0ae3-a94c-4011-94ce-473ebeac0629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:11.061890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e0ae3-a94c-4011-94ce-473ebeac0629 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:11.062204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e0ae3-a94c-4011-94ce-473ebeac0629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:11.062832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e0ae3-a94c-4011-94ce-473ebeac0629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:11.063186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e0ae3-a94c-4011-94ce-473ebeac0629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:11.065790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e0ae3-a94c-4011-94ce-473ebeac0629 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:11.175387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 946/1890] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:11 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:11.180040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:11.190549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812027c-892c-456a-adbf-ad2e0c0abfdb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:11.263814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b096938-2bd0-47cf-a519-bb8344632186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:11.264541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096938-2bd0-47cf-a519-bb8344632186 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:11.264839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096938-2bd0-47cf-a519-bb8344632186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:11.265104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b096938-2bd0-47cf-a519-bb8344632186 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:11.265827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b096938-2bd0-47cf-a519-bb8344632186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:11.268626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b096938-2bd0-47cf-a519-bb8344632186 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:11.406137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 945/1891] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:11 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:11.410310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e0ae3-a94c-4011-94ce-473ebeac0629 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:11.420353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e0ae3-a94c-4011-94ce-473ebeac0629 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:11.425323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444be574-53d2-4e6b-bb47-c9810fcb9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:11.425986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444be574-53d2-4e6b-bb47-c9810fcb9659 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:11.426294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444be574-53d2-4e6b-bb47-c9810fcb9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:11.426577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444be574-53d2-4e6b-bb47-c9810fcb9659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:11.427305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444be574-53d2-4e6b-bb47-c9810fcb9659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:11.428895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444be574-53d2-4e6b-bb47-c9810fcb9659 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:11.441989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 947/1892] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:11.445970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b096938-2bd0-47cf-a519-bb8344632186 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:11.456993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b096938-2bd0-47cf-a519-bb8344632186 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:11.461939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2436a-761e-43d1-b3c7-749fff6ca682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:11.462659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2436a-761e-43d1-b3c7-749fff6ca682 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:11.462948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2436a-761e-43d1-b3c7-749fff6ca682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:11.463213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2436a-761e-43d1-b3c7-749fff6ca682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:11.464752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2436a-761e-43d1-b3c7-749fff6ca682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:11.465522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2436a-761e-43d1-b3c7-749fff6ca682 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:11.478937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 946/1893] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:11.480412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444be574-53d2-4e6b-bb47-c9810fcb9659 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:11.491476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444be574-53d2-4e6b-bb47-c9810fcb9659 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:11.495901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8d225-e129-4253-a09a-8177a6e3ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:11.496988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d225-e129-4253-a09a-8177a6e3ef19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:11.497079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d225-e129-4253-a09a-8177a6e3ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:11.497318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8d225-e129-4253-a09a-8177a6e3ef19 admin admin] PATH_INFO: `/v3/projects/aae45f09823741dfbff83712f624ddf1/users/64ebe59f9fda4aa1b0fa56d40665090f/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:11.514585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8d225-e129-4253-a09a-8177a6e3ef19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae45f09823741dfbff83712f624ddf1, user_id=64ebe59f9fda4aa1b0fa56d40665090f, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:11.517245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8d225-e129-4253-a09a-8177a6e3ef19 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:11.662413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 948/1894] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:11 2022] PUT /identity/v3/projects/aae45f09823741dfbff83712f624ddf1/users/64ebe59f9fda4aa1b0fa56d40665090f/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:11.680558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e337e-3740-4c44-926e-11ecfce148ef None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:11.680844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e337e-3740-4c44-926e-11ecfce148ef None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:11.681120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e337e-3740-4c44-926e-11ecfce148ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:11.709008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-984e337e-3740-4c44-926e-11ecfce148ef None None] MFA Rules not processed for user `64ebe59f9fda4aa1b0fa56d40665090f`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:11.710239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-984e337e-3740-4c44-926e-11ecfce148ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:11.776973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 947/1895] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:11.787800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8d225-e129-4253-a09a-8177a6e3ef19 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:11.853194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8d225-e129-4253-a09a-8177a6e3ef19 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:11.858108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d107a-1480-424a-a677-574bbdfe5ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:11.858745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d107a-1480-424a-a677-574bbdfe5ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:11.859030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d107a-1480-424a-a677-574bbdfe5ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:11.859301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d107a-1480-424a-a677-574bbdfe5ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:11.860050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d107a-1480-424a-a677-574bbdfe5ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:11.863203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d107a-1480-424a-a677-574bbdfe5ba7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:11.989125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 949/1896] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:11 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:11.993203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e337e-3740-4c44-926e-11ecfce148ef None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:11.999855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:12.005129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e337e-3740-4c44-926e-11ecfce148ef None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:12.060672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d1f74-8e3f-49f0-9dbf-ba1a76c7cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:12.061421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d1f74-8e3f-49f0-9dbf-ba1a76c7cc6f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.061714 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d1f74-8e3f-49f0-9dbf-ba1a76c7cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.062035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d1f74-8e3f-49f0-9dbf-ba1a76c7cc6f admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.062741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d1f74-8e3f-49f0-9dbf-ba1a76c7cc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:12.064758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d1f74-8e3f-49f0-9dbf-ba1a76c7cc6f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:12.162051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 948/1897] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:11 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:12.163679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d107a-1480-424a-a677-574bbdfe5ba7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:12.173822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d107a-1480-424a-a677-574bbdfe5ba7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:12.179986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e4e9-8294-44c0-b273-e658b911fc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:12.180641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e4e9-8294-44c0-b273-e658b911fc78 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.180917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e4e9-8294-44c0-b273-e658b911fc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.181185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637e4e9-8294-44c0-b273-e658b911fc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.182805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637e4e9-8294-44c0-b273-e658b911fc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:12.185109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637e4e9-8294-44c0-b273-e658b911fc78 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:12.199613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 950/1898] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:12.200874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d1f74-8e3f-49f0-9dbf-ba1a76c7cc6f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:12.212064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d1f74-8e3f-49f0-9dbf-ba1a76c7cc6f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:12.216792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867653f-6af9-4778-be5f-79761667e8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:12.217511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867653f-6af9-4778-be5f-79761667e8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.217788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867653f-6af9-4778-be5f-79761667e8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.218096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867653f-6af9-4778-be5f-79761667e8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.218816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867653f-6af9-4778-be5f-79761667e8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:12.220499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867653f-6af9-4778-be5f-79761667e8b4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:12.231538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 949/1899] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:12.235885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e4e9-8294-44c0-b273-e658b911fc78 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:12.246936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637e4e9-8294-44c0-b273-e658b911fc78 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:12.251747 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:12.252623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.259194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.259194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] PATH_INFO: `/v3/projects/fd5c1b83996b47278af4db22c764934b/users/cdd5ce49dd674c8aa5638623a0d49491/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.267875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd5c1b83996b47278af4db22c764934b, user_id=cdd5ce49dd674c8aa5638623a0d49491, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:12.270752 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:12.360694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:12.367162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 951/1900] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:12 2022] PUT /identity/v3/projects/fd5c1b83996b47278af4db22c764934b/users/cdd5ce49dd674c8aa5638623a0d49491/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:12.377574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff810d-4470-4cb8-b003-aca52782cc55 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.377859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff810d-4470-4cb8-b003-aca52782cc55 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.378165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff810d-4470-4cb8-b003-aca52782cc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.403636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9aff810d-4470-4cb8-b003-aca52782cc55 None None] MFA Rules not processed for user `cdd5ce49dd674c8aa5638623a0d49491`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:12.404807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9aff810d-4470-4cb8-b003-aca52782cc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:12.453890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:12.457593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:12.485100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 950/1901] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:12.490059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff810d-4470-4cb8-b003-aca52782cc55 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:12.529425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f08a7-305e-481a-bcc5-70f36795f19e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:12.538427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:12.539348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.539722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.540003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] PATH_INFO: `/v3/users/1134e1fe0b53418696017b89168f1fd6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.541349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1134e1fe0b53418696017b89168f1fd6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:12.543431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:12.563624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff810d-4470-4cb8-b003-aca52782cc55 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:12.570593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a7aac-d871-4397-b8a6-a5942fdabd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:12.571439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a7aac-d871-4397-b8a6-a5942fdabd57 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.571788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a7aac-d871-4397-b8a6-a5942fdabd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.572881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a7aac-d871-4397-b8a6-a5942fdabd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.573967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a7aac-d871-4397-b8a6-a5942fdabd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:12.579062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a7aac-d871-4397-b8a6-a5942fdabd57 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:12.679280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:12.688993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 951/1902] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:12 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:12.691914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a7aac-d871-4397-b8a6-a5942fdabd57 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:12.741164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1134e1fe0b53418696017b89168f1fd6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:12.771892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a7aac-d871-4397-b8a6-a5942fdabd57 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:12.777154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501785ba-6111-4509-901c-52947d59598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:12.777816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501785ba-6111-4509-901c-52947d59598a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.778133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501785ba-6111-4509-901c-52947d59598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.778408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501785ba-6111-4509-901c-52947d59598a admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.779093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501785ba-6111-4509-901c-52947d59598a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:12.781037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501785ba-6111-4509-901c-52947d59598a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:12.821602 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1134e1fe0b53418696017b89168f1fd6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:12.833305 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1134e1fe0b53418696017b89168f1fd6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:12.834315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1134e1fe0b53418696017b89168f1fd6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:12.846884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-580fdc59-37b6-49e9-afdb-d0dd96a998ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1134e1fe0b53418696017b89168f1fd6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:12.854227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 952/1903] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:12 2022] DELETE /identity/v3/users/1134e1fe0b53418696017b89168f1fd6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:12.858409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce795-8fc7-4649-8345-dc5ce668f36a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.858702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce795-8fc7-4649-8345-dc5ce668f36a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.860393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce795-8fc7-4649-8345-dc5ce668f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.876533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8e0ce795-8fc7-4649-8345-dc5ce668f36a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:12.882812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8e0ce795-8fc7-4649-8345-dc5ce668f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:12.889062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 952/1904] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:12 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:12.892075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501785ba-6111-4509-901c-52947d59598a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:12.895777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-501785ba-6111-4509-901c-52947d59598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:12.915047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501785ba-6111-4509-901c-52947d59598a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:12.959042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 953/1905] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:12.971440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ce795-8fc7-4649-8345-dc5ce668f36a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:12.973225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8e0ce795-8fc7-4649-8345-dc5ce668f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:12.980800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b459659-11cf-4784-ad9a-375991c9666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:12.981480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459659-11cf-4784-ad9a-375991c9666c admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:12.981762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459659-11cf-4784-ad9a-375991c9666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:12.982071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b459659-11cf-4784-ad9a-375991c9666c admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:12.982803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b459659-11cf-4784-ad9a-375991c9666c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:12.984441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b459659-11cf-4784-ad9a-375991c9666c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:12.994873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 953/1906] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:12.998912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b459659-11cf-4784-ad9a-375991c9666c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:13.000541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:13.009127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b459659-11cf-4784-ad9a-375991c9666c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:13.013718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60cb68-6ce3-4146-a759-b13969abf910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:13.014639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60cb68-6ce3-4146-a759-b13969abf910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.016759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60cb68-6ce3-4146-a759-b13969abf910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.016759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60cb68-6ce3-4146-a759-b13969abf910 admin admin] PATH_INFO: `/v3/projects/25d3d42e59ae4b37bda9660a0efe6cb8/users/e5d38e44804842b081ad7d0db7040516/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.031100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60cb68-6ce3-4146-a759-b13969abf910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d3d42e59ae4b37bda9660a0efe6cb8, user_id=e5d38e44804842b081ad7d0db7040516, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:13.033795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60cb68-6ce3-4146-a759-b13969abf910 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:13.054244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ce795-8fc7-4649-8345-dc5ce668f36a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:13.058152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88860a73-938d-48dd-bc28-69f6cc799863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:13.058799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88860a73-938d-48dd-bc28-69f6cc799863 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.059080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88860a73-938d-48dd-bc28-69f6cc799863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.059354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88860a73-938d-48dd-bc28-69f6cc799863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.070608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88860a73-938d-48dd-bc28-69f6cc799863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:13.072064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88860a73-938d-48dd-bc28-69f6cc799863 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:13.087160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 954/1907] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:13.101284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 954/1908] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:12 2022] PUT /identity/v3/projects/25d3d42e59ae4b37bda9660a0efe6cb8/users/e5d38e44804842b081ad7d0db7040516/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:13.106100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88860a73-938d-48dd-bc28-69f6cc799863 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:13.119122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88860a73-938d-48dd-bc28-69f6cc799863 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:13.211126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4ef8b-6620-4d42-b628-9e43a69b9dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:13.211958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4ef8b-6620-4d42-b628-9e43a69b9dff admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.212245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4ef8b-6620-4d42-b628-9e43a69b9dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.212549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4ef8b-6620-4d42-b628-9e43a69b9dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.213277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4ef8b-6620-4d42-b628-9e43a69b9dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:13.214999 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4ef8b-6620-4d42-b628-9e43a69b9dff admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:13.227728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 955/1909] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:13.232008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60cb68-6ce3-4146-a759-b13969abf910 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:13.243501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60cb68-6ce3-4146-a759-b13969abf910 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:13.248235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:13.249111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.249388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.256813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] PATH_INFO: `/v3/projects/25d3d42e59ae4b37bda9660a0efe6cb8/users/e5d38e44804842b081ad7d0db7040516/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.256813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d3d42e59ae4b37bda9660a0efe6cb8, user_id=e5d38e44804842b081ad7d0db7040516, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:13.256813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:13.264798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 955/1910] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:13 2022] PUT /identity/v3/projects/25d3d42e59ae4b37bda9660a0efe6cb8/users/e5d38e44804842b081ad7d0db7040516/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:13.275636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd0ca-8fe8-4cb7-9c14-035b76b97f05 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.275924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd0ca-8fe8-4cb7-9c14-035b76b97f05 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.276201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd0ca-8fe8-4cb7-9c14-035b76b97f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.305138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b20bd0ca-8fe8-4cb7-9c14-035b76b97f05 None None] MFA Rules not processed for user `e5d38e44804842b081ad7d0db7040516`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:13.306411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b20bd0ca-8fe8-4cb7-9c14-035b76b97f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:13.378822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 956/1911] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:13.390958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:13.392963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:13.447607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:13.452584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967396d-a7d7-47c3-8d66-cf05ae77bd82 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:13.456969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:13.463761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.463761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.463761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.467835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:13.469284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:13.479983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 956/1912] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:13.560798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bd0ca-8fe8-4cb7-9c14-035b76b97f05 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:13.562241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b20bd0ca-8fe8-4cb7-9c14-035b76b97f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:13.608191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:13.612606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:13.614332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:13.625996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35ee7c-ad80-43d5-bf3b-9373f564871a service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:13.630339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:13.631010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.631286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.631556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.633367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:13.644732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bd0ca-8fe8-4cb7-9c14-035b76b97f05 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:13.649560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:13.650455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.650737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.651013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] PATH_INFO: `/v3/projects/25f4ed68f63d4e388e8ca0b850836463` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.652191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f4ed68f63d4e388e8ca0b850836463)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:13.654607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:13.698265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:13.699737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:13.710198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 957/1913] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:43:13.793632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f4ed68f63d4e388e8ca0b850836463', 'request_id': 'req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:13.856375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f4ed68f63d4e388e8ca0b850836463', 'request_id': 'req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:13.862878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f4ed68f63d4e388e8ca0b850836463', 'request_id': 'req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:13.874205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] The token cache is being invalidate because project 25f4ed68f63d4e388e8ca0b850836463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:13.874494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:13.875170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:13.876715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 957/1914] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:13 2022] DELETE /identity/v3/projects/25f4ed68f63d4e388e8ca0b850836463 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:13.881475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:13.892019 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc2b7-2f01-4b63-bb52-c447b76cb7d3 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:13.952020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:13.952948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:13.953229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:13.953501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] PATH_INFO: `/v3/users/90c5a0c3daa0401781ef1a345a9078ae` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:13.954717 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c5a0c3daa0401781ef1a345a9078ae)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:13.957718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:14.180179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c5a0c3daa0401781ef1a345a9078ae'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:14.180843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c5a0c3daa0401781ef1a345a9078ae'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:14.273260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c5a0c3daa0401781ef1a345a9078ae'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:14.287220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c5a0c3daa0401781ef1a345a9078ae'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:14.294142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2730c289-c609-4d20-a68b-a77bfe58732c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c5a0c3daa0401781ef1a345a9078ae'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:14.301776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 958/1915] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:13 2022] DELETE /identity/v3/users/90c5a0c3daa0401781ef1a345a9078ae => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:14.696915 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:14.698393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:14.735099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ab24e-0fca-47b5-a302-fd5d4ab1d0a3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:14.790269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:14.791118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:14.791396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:14.791664 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] PATH_INFO: `/v3/projects/536c593e00ea4225a0e279dd09954f54` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:14.792819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] RBAC: Authorizing `identity:delete_project(project_id=536c593e00ea4225a0e279dd09954f54)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:14.794729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:14.924084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:14.928398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536c593e00ea4225a0e279dd09954f54', 'request_id': 'req-6d70d6af-6083-4263-a3c0-61ed7797923d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:14.993583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536c593e00ea4225a0e279dd09954f54', 'request_id': 'req-6d70d6af-6083-4263-a3c0-61ed7797923d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:15.000006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536c593e00ea4225a0e279dd09954f54', 'request_id': 'req-6d70d6af-6083-4263-a3c0-61ed7797923d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:15.011899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] The token cache is being invalidate because project 536c593e00ea4225a0e279dd09954f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:15.012247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:15.012927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6d70d6af-6083-4263-a3c0-61ed7797923d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:15.014590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 958/1916] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:14 2022] DELETE /identity/v3/projects/536c593e00ea4225a0e279dd09954f54 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:15.021861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261917-da3e-4172-9cc4-7fbf5e7471f6 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.023523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261917-da3e-4172-9cc4-7fbf5e7471f6 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.023523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261917-da3e-4172-9cc4-7fbf5e7471f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.034362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:15.075730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e2261917-da3e-4172-9cc4-7fbf5e7471f6 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:15.076932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e2261917-da3e-4172-9cc4-7fbf5e7471f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:15.133769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 959/1917] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:15.141660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4620-c107-439a-851f-dbffa8d41205 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.142223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4620-c107-439a-851f-dbffa8d41205 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.142761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4620-c107-439a-851f-dbffa8d41205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.162342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-301c4620-c107-439a-851f-dbffa8d41205 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:15.163538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-301c4620-c107-439a-851f-dbffa8d41205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:15.171385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 959/1918] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:15.175844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261917-da3e-4172-9cc4-7fbf5e7471f6 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:15.185691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261917-da3e-4172-9cc4-7fbf5e7471f6 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:15.190422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:15.191614 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.191892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.192158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.192865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:15.193161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:15.194762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:15.207312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 960/1919] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:15.211359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c4620-c107-439a-851f-dbffa8d41205 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:15.221344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c4620-c107-439a-851f-dbffa8d41205 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:15.227820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c415f-dbdb-4998-bcd8-8d648519029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:15.228564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c415f-dbdb-4998-bcd8-8d648519029d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.228947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c415f-dbdb-4998-bcd8-8d648519029d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.229295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c415f-dbdb-4998-bcd8-8d648519029d admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.230229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c415f-dbdb-4998-bcd8-8d648519029d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:15.232506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c415f-dbdb-4998-bcd8-8d648519029d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:15.314769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 960/1920] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:15 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:15.319690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:15.332211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c897e8-80d5-49a4-9c89-4a51696e651b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:15.396488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c150386-eb22-4e3f-8938-fdd423986aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:15.397163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150386-eb22-4e3f-8938-fdd423986aad admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.397446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150386-eb22-4e3f-8938-fdd423986aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.397731 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c150386-eb22-4e3f-8938-fdd423986aad admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.398473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c150386-eb22-4e3f-8938-fdd423986aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:15.400396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c150386-eb22-4e3f-8938-fdd423986aad admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:15.479289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 961/1921] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:15 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:15.483440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c415f-dbdb-4998-bcd8-8d648519029d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:15.497532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c415f-dbdb-4998-bcd8-8d648519029d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:15.504436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8305-67e5-43a3-97b3-025eb1e455d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:15.505121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8305-67e5-43a3-97b3-025eb1e455d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.505408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8305-67e5-43a3-97b3-025eb1e455d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.505686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8305-67e5-43a3-97b3-025eb1e455d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.506461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db8305-67e5-43a3-97b3-025eb1e455d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:15.508048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db8305-67e5-43a3-97b3-025eb1e455d4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:15.519422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 961/1922] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:15.523702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c150386-eb22-4e3f-8938-fdd423986aad admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:15.534074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c150386-eb22-4e3f-8938-fdd423986aad admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:15.538872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f0176-e0f6-471f-867f-59654e20af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:15.539524 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0176-e0f6-471f-867f-59654e20af7b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.539815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0176-e0f6-471f-867f-59654e20af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.540139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f0176-e0f6-471f-867f-59654e20af7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.540816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f0176-e0f6-471f-867f-59654e20af7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:15.542440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f0176-e0f6-471f-867f-59654e20af7b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:15.552825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 962/1923] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:15.557302 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8305-67e5-43a3-97b3-025eb1e455d4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:15.567990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8305-67e5-43a3-97b3-025eb1e455d4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:15.575681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409675-05f5-4571-aefb-6240a30b4b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:15.575681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409675-05f5-4571-aefb-6240a30b4b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.575681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409675-05f5-4571-aefb-6240a30b4b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.575681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409675-05f5-4571-aefb-6240a30b4b66 admin admin] PATH_INFO: `/v3/projects/eec5941f90814be3b1705a8b5eeacdf4/users/c9623590cd304beab220523b5c98a1f0/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.591161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409675-05f5-4571-aefb-6240a30b4b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec5941f90814be3b1705a8b5eeacdf4, user_id=c9623590cd304beab220523b5c98a1f0, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:15.593824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409675-05f5-4571-aefb-6240a30b4b66 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:15.683978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 962/1924] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:15 2022] PUT /identity/v3/projects/eec5941f90814be3b1705a8b5eeacdf4/users/c9623590cd304beab220523b5c98a1f0/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:15.695806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbe158-0c5d-47d6-9ed4-d6ad21a40db0 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.696094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbe158-0c5d-47d6-9ed4-d6ad21a40db0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.696371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbe158-0c5d-47d6-9ed4-d6ad21a40db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.723307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-89fbe158-0c5d-47d6-9ed4-d6ad21a40db0 None None] MFA Rules not processed for user `c9623590cd304beab220523b5c98a1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:15.724440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-89fbe158-0c5d-47d6-9ed4-d6ad21a40db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:15.766401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:15.790866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 963/1925] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:15.795378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409675-05f5-4571-aefb-6240a30b4b66 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:15.868900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409675-05f5-4571-aefb-6240a30b4b66 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:15.873878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e39634-ce4d-4c81-9fc0-d7445c94973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:15.874570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39634-ce4d-4c81-9fc0-d7445c94973a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:15.874884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39634-ce4d-4c81-9fc0-d7445c94973a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:15.875233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39634-ce4d-4c81-9fc0-d7445c94973a admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:15.875848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e39634-ce4d-4c81-9fc0-d7445c94973a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:15.877737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e39634-ce4d-4c81-9fc0-d7445c94973a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:15.990595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 963/1926] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:15 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:15.994368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbe158-0c5d-47d6-9ed4-d6ad21a40db0 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:16.005201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbe158-0c5d-47d6-9ed4-d6ad21a40db0 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:16.071376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d81dd8-f8b0-43ba-b630-d2380f7ebc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:16.072049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81dd8-f8b0-43ba-b630-d2380f7ebc48 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:16.072335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81dd8-f8b0-43ba-b630-d2380f7ebc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:16.072609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d81dd8-f8b0-43ba-b630-d2380f7ebc48 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:16.073298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d81dd8-f8b0-43ba-b630-d2380f7ebc48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:16.075336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d81dd8-f8b0-43ba-b630-d2380f7ebc48 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:16.186789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 964/1927] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:15 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:16.192813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e39634-ce4d-4c81-9fc0-d7445c94973a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:16.202965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e39634-ce4d-4c81-9fc0-d7445c94973a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:16.207960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e672750-ab24-417e-8317-35b1fe6fa937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:16.208616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e672750-ab24-417e-8317-35b1fe6fa937 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:16.208901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e672750-ab24-417e-8317-35b1fe6fa937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:16.209177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e672750-ab24-417e-8317-35b1fe6fa937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:16.209909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e672750-ab24-417e-8317-35b1fe6fa937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:16.211525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e672750-ab24-417e-8317-35b1fe6fa937 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:16.222695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 964/1928] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:16.226859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d81dd8-f8b0-43ba-b630-d2380f7ebc48 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:16.236690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d81dd8-f8b0-43ba-b630-d2380f7ebc48 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:16.241945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a646-35df-4a4b-a822-96a5c5f3c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:16.242941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a646-35df-4a4b-a822-96a5c5f3c1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:16.243270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a646-35df-4a4b-a822-96a5c5f3c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:16.243878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80a646-35df-4a4b-a822-96a5c5f3c1bf admin admin] PATH_INFO: `/v3/projects/724a000800974861953337bdbf529a12/users/c029d7dfc5a741a49fa96f568e00aa95/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:16.260934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80a646-35df-4a4b-a822-96a5c5f3c1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=724a000800974861953337bdbf529a12, user_id=c029d7dfc5a741a49fa96f568e00aa95, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:16.261969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80a646-35df-4a4b-a822-96a5c5f3c1bf admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:16.336687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 965/1929] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:16 2022] PUT /identity/v3/projects/724a000800974861953337bdbf529a12/users/c029d7dfc5a741a49fa96f568e00aa95/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:16.340576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e672750-ab24-417e-8317-35b1fe6fa937 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:16.351355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e672750-ab24-417e-8317-35b1fe6fa937 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:16.396521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:16.413402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356392f-eb8b-4d14-81b6-f9c7384324eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:16.414133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356392f-eb8b-4d14-81b6-f9c7384324eb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:16.414420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356392f-eb8b-4d14-81b6-f9c7384324eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:16.414698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356392f-eb8b-4d14-81b6-f9c7384324eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:16.415432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356392f-eb8b-4d14-81b6-f9c7384324eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:16.417007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356392f-eb8b-4d14-81b6-f9c7384324eb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:16.427229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 965/1930] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:16.431892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a646-35df-4a4b-a822-96a5c5f3c1bf admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:16.442610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80a646-35df-4a4b-a822-96a5c5f3c1bf admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:16.449519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:16.450519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:16.450890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:16.451240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] PATH_INFO: `/v3/projects/724a000800974861953337bdbf529a12/users/c029d7dfc5a741a49fa96f568e00aa95/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:16.453254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724a000800974861953337bdbf529a12, user_id=c029d7dfc5a741a49fa96f568e00aa95, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:16.455960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:16.467686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 966/1931] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:16 2022] PUT /identity/v3/projects/724a000800974861953337bdbf529a12/users/c029d7dfc5a741a49fa96f568e00aa95/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:16.478428 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd19bf-0e2e-40bc-8115-a3883f9de22e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:16.478719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd19bf-0e2e-40bc-8115-a3883f9de22e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:16.478992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd19bf-0e2e-40bc-8115-a3883f9de22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:16.504887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6cfd19bf-0e2e-40bc-8115-a3883f9de22e None None] MFA Rules not processed for user `c029d7dfc5a741a49fa96f568e00aa95`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:16.506079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6cfd19bf-0e2e-40bc-8115-a3883f9de22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:16.583342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 966/1932] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:16.594550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:16.596210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:16.652718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a139a-4970-4ffe-9c7e-8de87bb8bae5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:16.656411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851b108-7511-4c2a-994f-d462c3cd26b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:16.657053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b108-7511-4c2a-994f-d462c3cd26b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:16.657334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b108-7511-4c2a-994f-d462c3cd26b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:16.657606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851b108-7511-4c2a-994f-d462c3cd26b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:16.667413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851b108-7511-4c2a-994f-d462c3cd26b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:16.668838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851b108-7511-4c2a-994f-d462c3cd26b1 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:16.678278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 967/1933] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:16.707000 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd19bf-0e2e-40bc-8115-a3883f9de22e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:16.768489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd19bf-0e2e-40bc-8115-a3883f9de22e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:16.773625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:16.774520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:16.774799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:16.775070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] PATH_INFO: `/v3/users/c9623590cd304beab220523b5c98a1f0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:16.776253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9623590cd304beab220523b5c98a1f0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:16.778211 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:16.967581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9623590cd304beab220523b5c98a1f0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:17.015511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9623590cd304beab220523b5c98a1f0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:17.023886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9623590cd304beab220523b5c98a1f0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:17.024501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9623590cd304beab220523b5c98a1f0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:17.026389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:17.036919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9623590cd304beab220523b5c98a1f0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:17.043291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 967/1934] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:16 2022] DELETE /identity/v3/users/c9623590cd304beab220523b5c98a1f0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:17.047588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc5c18-cd9e-4267-baba-aad6bff9163c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:17.047877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc5c18-cd9e-4267-baba-aad6bff9163c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:17.048323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc5c18-cd9e-4267-baba-aad6bff9163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:17.067718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cafc5c18-cd9e-4267-baba-aad6bff9163c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:17.068904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cafc5c18-cd9e-4267-baba-aad6bff9163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:17.098600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:17.126549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 968/1935] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:17.136851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:17.138328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:17.216973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f96ba0-d26d-4baf-9322-80bebca1ece7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:17.220734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bdf89-89a3-458a-873e-3e1bd43df825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:17.221386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bdf89-89a3-458a-873e-3e1bd43df825 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:17.221654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bdf89-89a3-458a-873e-3e1bd43df825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:17.222234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bdf89-89a3-458a-873e-3e1bd43df825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:17.232181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bdf89-89a3-458a-873e-3e1bd43df825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:17.233598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bdf89-89a3-458a-873e-3e1bd43df825 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:17.244441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 968/1936] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:17.800709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc5c18-cd9e-4267-baba-aad6bff9163c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:17.803607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cafc5c18-cd9e-4267-baba-aad6bff9163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:17.814470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc5c18-cd9e-4267-baba-aad6bff9163c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:17.819106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:17.819986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:17.820242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:17.820517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] PATH_INFO: `/v3/projects/eec5941f90814be3b1705a8b5eeacdf4` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:17.821717 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec5941f90814be3b1705a8b5eeacdf4)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:17.823670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:17.948134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec5941f90814be3b1705a8b5eeacdf4', 'request_id': 'req-0f70812c-7806-4017-b713-3449deb9a64b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.004391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec5941f90814be3b1705a8b5eeacdf4', 'request_id': 'req-0f70812c-7806-4017-b713-3449deb9a64b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.010875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec5941f90814be3b1705a8b5eeacdf4', 'request_id': 'req-0f70812c-7806-4017-b713-3449deb9a64b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.023773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] The token cache is being invalidate because project eec5941f90814be3b1705a8b5eeacdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:18.024039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.024741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.026322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 969/1937] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:17 2022] DELETE /identity/v3/projects/eec5941f90814be3b1705a8b5eeacdf4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:18.030311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bdf89-89a3-458a-873e-3e1bd43df825 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:18.042864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bdf89-89a3-458a-873e-3e1bd43df825 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:18.108265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:18.109139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:18.109421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:18.109697 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] PATH_INFO: `/v3/users/c029d7dfc5a741a49fa96f568e00aa95` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:18.111026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c029d7dfc5a741a49fa96f568e00aa95)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:18.113310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:18.298349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c029d7dfc5a741a49fa96f568e00aa95'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.369497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c029d7dfc5a741a49fa96f568e00aa95'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.378786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c029d7dfc5a741a49fa96f568e00aa95'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.378786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c029d7dfc5a741a49fa96f568e00aa95'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.382989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:18.391255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3755d2f0-3382-4cfa-b9db-f6201ef42449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c029d7dfc5a741a49fa96f568e00aa95'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:18.398382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 969/1938] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:18 2022] DELETE /identity/v3/users/c029d7dfc5a741a49fa96f568e00aa95 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:19.069564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:19.071490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:19.090697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70812c-7806-4017-b713-3449deb9a64b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:19.178977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:19.180710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:19.181225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:19.181785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] PATH_INFO: `/v3/projects/724a000800974861953337bdbf529a12` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:19.184083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] RBAC: Authorizing `identity:delete_project(project_id=724a000800974861953337bdbf529a12)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:19.193325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:19.328426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724a000800974861953337bdbf529a12', 'request_id': 'req-e4dc589e-935e-45cf-aa89-ae43248a212d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:19.414989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724a000800974861953337bdbf529a12', 'request_id': 'req-e4dc589e-935e-45cf-aa89-ae43248a212d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:19.423294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:19.425810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724a000800974861953337bdbf529a12', 'request_id': 'req-e4dc589e-935e-45cf-aa89-ae43248a212d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:19.437965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] The token cache is being invalidate because project 724a000800974861953337bdbf529a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:19.438748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:19.439026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e4dc589e-935e-45cf-aa89-ae43248a212d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:19.440768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 970/1939] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:19 2022] DELETE /identity/v3/projects/724a000800974861953337bdbf529a12 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:19.446313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084cc9-5a2c-4628-8790-b9f3150faa8a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:19.452994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084cc9-5a2c-4628-8790-b9f3150faa8a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:19.452994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084cc9-5a2c-4628-8790-b9f3150faa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:19.465857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ad084cc9-5a2c-4628-8790-b9f3150faa8a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:19.467087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ad084cc9-5a2c-4628-8790-b9f3150faa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:19.527836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 970/1940] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:19.536406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2f4b-f74a-435e-820b-76f6509cc4d9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:19.536694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2f4b-f74a-435e-820b-76f6509cc4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:19.536993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a2f4b-f74a-435e-820b-76f6509cc4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:19.555360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a41a2f4b-f74a-435e-820b-76f6509cc4d9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:19.556544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a41a2f4b-f74a-435e-820b-76f6509cc4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:19.564642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 971/1941] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:19.573772 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084cc9-5a2c-4628-8790-b9f3150faa8a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:19.579155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084cc9-5a2c-4628-8790-b9f3150faa8a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:19.584607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:19.585355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:19.585674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:19.585955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:19.586723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:19.587033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:19.588616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:19.603104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 971/1942] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:43:19.615441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2f4b-f74a-435e-820b-76f6509cc4d9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:19.630145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a2f4b-f74a-435e-820b-76f6509cc4d9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:19.637775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01366a-8444-4ead-8c93-a96e5fb4927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:19.638476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01366a-8444-4ead-8c93-a96e5fb4927e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:19.639537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01366a-8444-4ead-8c93-a96e5fb4927e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:19.639537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01366a-8444-4ead-8c93-a96e5fb4927e admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:19.639939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01366a-8444-4ead-8c93-a96e5fb4927e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:19.641887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01366a-8444-4ead-8c93-a96e5fb4927e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:19.747910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 972/1943] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:19 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:19.750189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:19.763670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc554bd-231b-4b5c-ba3f-bb4218faccdd admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:19.836121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203a22-da00-42d5-b77a-445e47556d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:19.836998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203a22-da00-42d5-b77a-445e47556d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:19.837178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203a22-da00-42d5-b77a-445e47556d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:19.837488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f203a22-da00-42d5-b77a-445e47556d2b admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:19.838225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203a22-da00-42d5-b77a-445e47556d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:19.840180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f203a22-da00-42d5-b77a-445e47556d2b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:19.903526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 972/1944] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:19 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:19.908377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01366a-8444-4ead-8c93-a96e5fb4927e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:19.920150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01366a-8444-4ead-8c93-a96e5fb4927e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:19.925157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7b4c-2157-4363-8b8c-64280a690b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:19.926221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7b4c-2157-4363-8b8c-64280a690b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:19.926506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7b4c-2157-4363-8b8c-64280a690b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:19.926782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7b4c-2157-4363-8b8c-64280a690b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:19.927514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7b4c-2157-4363-8b8c-64280a690b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:19.929642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7b4c-2157-4363-8b8c-64280a690b16 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:19.941274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 973/1945] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:19.946180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203a22-da00-42d5-b77a-445e47556d2b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:19.957856 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f203a22-da00-42d5-b77a-445e47556d2b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:19.962716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44630596-8140-4179-9f58-be6f6e2238c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:19.963374 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630596-8140-4179-9f58-be6f6e2238c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:19.963653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630596-8140-4179-9f58-be6f6e2238c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:19.963928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630596-8140-4179-9f58-be6f6e2238c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:19.964656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44630596-8140-4179-9f58-be6f6e2238c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:19.966259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44630596-8140-4179-9f58-be6f6e2238c7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:19.977156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 973/1946] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:19.981594 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7b4c-2157-4363-8b8c-64280a690b16 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:19.993657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7b4c-2157-4363-8b8c-64280a690b16 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:19.999582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e651e6-800b-48a6-9d0d-a29d1436ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:20.000586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e651e6-800b-48a6-9d0d-a29d1436ebe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.001092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e651e6-800b-48a6-9d0d-a29d1436ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.001447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e651e6-800b-48a6-9d0d-a29d1436ebe4 admin admin] PATH_INFO: `/v3/projects/c82470cba4a7465897c5167d50dc1b97/users/9dbcf7ba67024e25bbb702aec69d2559/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.019681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e651e6-800b-48a6-9d0d-a29d1436ebe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82470cba4a7465897c5167d50dc1b97, user_id=9dbcf7ba67024e25bbb702aec69d2559, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:20.022387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e651e6-800b-48a6-9d0d-a29d1436ebe4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:20.107641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 974/1947] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:19 2022] PUT /identity/v3/projects/c82470cba4a7465897c5167d50dc1b97/users/9dbcf7ba67024e25bbb702aec69d2559/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:20.122029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e307-b4a1-4a03-9856-17f4deaae632 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.122406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e307-b4a1-4a03-9856-17f4deaae632 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.122788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e307-b4a1-4a03-9856-17f4deaae632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.152300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9a6e307-b4a1-4a03-9856-17f4deaae632 None None] MFA Rules not processed for user `9dbcf7ba67024e25bbb702aec69d2559`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:20.153513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9a6e307-b4a1-4a03-9856-17f4deaae632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:20.224767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:20.245863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e651e6-800b-48a6-9d0d-a29d1436ebe4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:20.248026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 974/1948] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:20.312123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e651e6-800b-48a6-9d0d-a29d1436ebe4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:20.317707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fb598-648f-4267-bf72-ea95f15a5660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:20.318390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb598-648f-4267-bf72-ea95f15a5660 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.318672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb598-648f-4267-bf72-ea95f15a5660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.318947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fb598-648f-4267-bf72-ea95f15a5660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.319628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fb598-648f-4267-bf72-ea95f15a5660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:20.321534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fb598-648f-4267-bf72-ea95f15a5660 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:20.393888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 975/1949] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:20 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:20.398185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e307-b4a1-4a03-9856-17f4deaae632 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:20.408480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e307-b4a1-4a03-9856-17f4deaae632 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:20.465874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a50788-e139-4781-bf8f-def1d474044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:20.466635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50788-e139-4781-bf8f-def1d474044f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.466917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50788-e139-4781-bf8f-def1d474044f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.467208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a50788-e139-4781-bf8f-def1d474044f admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.467875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a50788-e139-4781-bf8f-def1d474044f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:20.469873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a50788-e139-4781-bf8f-def1d474044f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:20.542057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 975/1950] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:20 2022] POST /identity/v3/users => generated 302 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:20.545760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fb598-648f-4267-bf72-ea95f15a5660 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:20.557105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fb598-648f-4267-bf72-ea95f15a5660 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:20.563280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5f7c-cbb2-4057-90a8-90ed83a9c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:20.563927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5f7c-cbb2-4057-90a8-90ed83a9c218 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.564206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5f7c-cbb2-4057-90a8-90ed83a9c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.564503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a5f7c-cbb2-4057-90a8-90ed83a9c218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.565223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a5f7c-cbb2-4057-90a8-90ed83a9c218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:20.566975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a5f7c-cbb2-4057-90a8-90ed83a9c218 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:20.577515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 976/1951] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:20.581507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a50788-e139-4781-bf8f-def1d474044f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:20.591265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a50788-e139-4781-bf8f-def1d474044f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:20.595823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09323e72-d7e0-4cc7-b333-faa543b85570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:20.597230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323e72-d7e0-4cc7-b333-faa543b85570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.597672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323e72-d7e0-4cc7-b333-faa543b85570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.597987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09323e72-d7e0-4cc7-b333-faa543b85570 admin admin] PATH_INFO: `/v3/projects/f95cbfaa6aee4c98ac7b99b1daefe272/users/fc0aeee21ac941a1ada8656926a7352e/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.613960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09323e72-d7e0-4cc7-b333-faa543b85570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95cbfaa6aee4c98ac7b99b1daefe272, user_id=fc0aeee21ac941a1ada8656926a7352e, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:20.616584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09323e72-d7e0-4cc7-b333-faa543b85570 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:20.678673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 976/1952] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:20 2022] PUT /identity/v3/projects/f95cbfaa6aee4c98ac7b99b1daefe272/users/fc0aeee21ac941a1ada8656926a7352e/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:20.682846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5f7c-cbb2-4057-90a8-90ed83a9c218 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:20.692922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a5f7c-cbb2-4057-90a8-90ed83a9c218 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:20.748912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e11af-8832-4a6a-9808-4471db05729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:20.749569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e11af-8832-4a6a-9808-4471db05729a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.749849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e11af-8832-4a6a-9808-4471db05729a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.750155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e11af-8832-4a6a-9808-4471db05729a admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.750875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e11af-8832-4a6a-9808-4471db05729a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:20.752463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e11af-8832-4a6a-9808-4471db05729a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:20.753849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:20.762815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 977/1953] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:20.766942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09323e72-d7e0-4cc7-b333-faa543b85570 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:20.777264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09323e72-d7e0-4cc7-b333-faa543b85570 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:20.781896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:20.782833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.783112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.783386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] PATH_INFO: `/v3/projects/f95cbfaa6aee4c98ac7b99b1daefe272/users/fc0aeee21ac941a1ada8656926a7352e/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.786315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95cbfaa6aee4c98ac7b99b1daefe272, user_id=fc0aeee21ac941a1ada8656926a7352e, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:20.788900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:20.799314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 977/1954] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:20 2022] PUT /identity/v3/projects/f95cbfaa6aee4c98ac7b99b1daefe272/users/fc0aeee21ac941a1ada8656926a7352e/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:20.810611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9844-53fb-448b-a964-eec8cd102c05 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:20.811150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9844-53fb-448b-a964-eec8cd102c05 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:20.811839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9844-53fb-448b-a964-eec8cd102c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:20.843725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f05a9844-53fb-448b-a964-eec8cd102c05 None None] MFA Rules not processed for user `fc0aeee21ac941a1ada8656926a7352e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:20.844861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f05a9844-53fb-448b-a964-eec8cd102c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:20.920833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 978/1955] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:20.932356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:20.933981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:21.006286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068f67e-1f1e-431f-a21c-94723b804472 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:21.009858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:21.010626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:21.010907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:21.011270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:21.022306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:21.023715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:21.034096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 978/1956] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:21.097898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9844-53fb-448b-a964-eec8cd102c05 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:21.107312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9844-53fb-448b-a964-eec8cd102c05 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:21.110881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842df9a-9dc5-4725-8b4f-3bd24c9dd970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:21.111510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842df9a-9dc5-4725-8b4f-3bd24c9dd970 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:21.111785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842df9a-9dc5-4725-8b4f-3bd24c9dd970 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:21.112056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842df9a-9dc5-4725-8b4f-3bd24c9dd970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:21.173029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842df9a-9dc5-4725-8b4f-3bd24c9dd970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:21.173029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842df9a-9dc5-4725-8b4f-3bd24c9dd970 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:21.178463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 979/1957] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:21.318081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:21.319452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:21.360380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:21.385682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351515c-247f-4c8c-9664-79434bea7c41 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:21.390663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:21.391565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:21.391849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:21.403814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] PATH_INFO: `/v3/users/0bf55d6b2f7a42f5b6d0a95b83c65660` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:21.403814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf55d6b2f7a42f5b6d0a95b83c65660)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:21.403814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:21.619559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf55d6b2f7a42f5b6d0a95b83c65660'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:21.695420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf55d6b2f7a42f5b6d0a95b83c65660'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:21.702960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf55d6b2f7a42f5b6d0a95b83c65660'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:21.703610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf55d6b2f7a42f5b6d0a95b83c65660'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:21.715575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf55d6b2f7a42f5b6d0a95b83c65660'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:21.721427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 979/1958] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:21 2022] DELETE /identity/v3/users/0bf55d6b2f7a42f5b6d0a95b83c65660 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:21.726075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7320-3b1b-4beb-8636-050dae81f719 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:21.726322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7320-3b1b-4beb-8636-050dae81f719 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:21.726596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7320-3b1b-4beb-8636-050dae81f719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:21.744154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ed8f7320-3b1b-4beb-8636-050dae81f719 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:21.745382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ed8f7320-3b1b-4beb-8636-050dae81f719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:21.814145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 980/1959] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:21.824003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:21.825455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:21.898654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119461-3e31-41ba-83ce-2854373ac078 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:21.902345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60932a4-fbe0-4ec4-94a3-42c066e6e618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:21.902993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60932a4-fbe0-4ec4-94a3-42c066e6e618 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:21.903433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60932a4-fbe0-4ec4-94a3-42c066e6e618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:21.904184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60932a4-fbe0-4ec4-94a3-42c066e6e618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:21.913545 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60932a4-fbe0-4ec4-94a3-42c066e6e618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:21.915182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60932a4-fbe0-4ec4-94a3-42c066e6e618 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:21.925441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 980/1960] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:22.400313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f7320-3b1b-4beb-8636-050dae81f719 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:22.401866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ed8f7320-3b1b-4beb-8636-050dae81f719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:22.414182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f7320-3b1b-4beb-8636-050dae81f719 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:22.418854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:22.419718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:22.420022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:22.420302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] PATH_INFO: `/v3/projects/6fdfeb6f48b049429b125bad66e7aa6f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:22.421517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fdfeb6f48b049429b125bad66e7aa6f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:22.423467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:22.441351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:22.529853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fdfeb6f48b049429b125bad66e7aa6f', 'request_id': 'req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.587228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fdfeb6f48b049429b125bad66e7aa6f', 'request_id': 'req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.593937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fdfeb6f48b049429b125bad66e7aa6f', 'request_id': 'req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.605427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] The token cache is being invalidate because project 6fdfeb6f48b049429b125bad66e7aa6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:22.605709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.606431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.608045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 981/1961] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:22 2022] DELETE /identity/v3/projects/6fdfeb6f48b049429b125bad66e7aa6f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:22.611856 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60932a4-fbe0-4ec4-94a3-42c066e6e618 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:22.622581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60932a4-fbe0-4ec4-94a3-42c066e6e618 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:22.675764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:22.681813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:22.682730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:22.683014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:22.683289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] PATH_INFO: `/v3/users/c1f5cecd063c4925a0addb424c84a716` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:22.684499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f5cecd063c4925a0addb424c84a716)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:22.686549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:22.849206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f5cecd063c4925a0addb424c84a716'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.912675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f5cecd063c4925a0addb424c84a716'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.920515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f5cecd063c4925a0addb424c84a716'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.921145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f5cecd063c4925a0addb424c84a716'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.934287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2baaf4fd-7c8a-43ed-be1b-f3c60fc0a365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f5cecd063c4925a0addb424c84a716'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:22.940205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 981/1962] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:22 2022] DELETE /identity/v3/users/c1f5cecd063c4925a0addb424c84a716 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:23.324858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:23.326441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:23.340537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3f699-0e60-4c31-8aad-81d1f1c869e3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:23.415358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:23.416239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:23.416608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:23.416879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] PATH_INFO: `/v3/projects/bac600a0d0434eeba9ae2d0451bffe8e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:23.418096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac600a0d0434eeba9ae2d0451bffe8e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:23.419986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:23.507313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac600a0d0434eeba9ae2d0451bffe8e', 'request_id': 'req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:23.569639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac600a0d0434eeba9ae2d0451bffe8e', 'request_id': 'req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:23.575314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac600a0d0434eeba9ae2d0451bffe8e', 'request_id': 'req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:23.586853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] The token cache is being invalidate because project bac600a0d0434eeba9ae2d0451bffe8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:23.587136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:23.587771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4dc54f8c-59b2-4564-80d1-dad120d0ae9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:23.589587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 982/1963] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:23 2022] DELETE /identity/v3/projects/bac600a0d0434eeba9ae2d0451bffe8e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:23.594344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4c51-e566-4230-b7ce-3c1b023c3067 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:23.594629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4c51-e566-4230-b7ce-3c1b023c3067 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:23.594908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4c51-e566-4230-b7ce-3c1b023c3067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:23.612731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a6af4c51-e566-4230-b7ce-3c1b023c3067 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:23.614086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a6af4c51-e566-4230-b7ce-3c1b023c3067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:23.674203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 982/1964] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:23.681959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060047b9-6c10-4494-8a9f-bcc203db6b2f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:23.682279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060047b9-6c10-4494-8a9f-bcc203db6b2f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:23.682556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060047b9-6c10-4494-8a9f-bcc203db6b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:23.700827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-060047b9-6c10-4494-8a9f-bcc203db6b2f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:23.702017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-060047b9-6c10-4494-8a9f-bcc203db6b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:23.710511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 983/1965] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:23.714534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af4c51-e566-4230-b7ce-3c1b023c3067 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:23.724179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af4c51-e566-4230-b7ce-3c1b023c3067 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:23.728827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65978392-467a-450c-9077-73cb176f892c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:23.729472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65978392-467a-450c-9077-73cb176f892c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:23.729758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65978392-467a-450c-9077-73cb176f892c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:23.730070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65978392-467a-450c-9077-73cb176f892c admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:23.730800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65978392-467a-450c-9077-73cb176f892c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:23.731774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65978392-467a-450c-9077-73cb176f892c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:23.732680 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65978392-467a-450c-9077-73cb176f892c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:23.744105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 983/1966] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:23.748276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060047b9-6c10-4494-8a9f-bcc203db6b2f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:23.758212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060047b9-6c10-4494-8a9f-bcc203db6b2f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:23.762858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b886b3-2496-403f-b83d-cdc8dd96d068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:23.763494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b886b3-2496-403f-b83d-cdc8dd96d068 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:23.763776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b886b3-2496-403f-b83d-cdc8dd96d068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:23.764051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b886b3-2496-403f-b83d-cdc8dd96d068 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:23.764741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b886b3-2496-403f-b83d-cdc8dd96d068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:23.766688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b886b3-2496-403f-b83d-cdc8dd96d068 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:23.849144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 984/1967] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:23 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:23.850334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65978392-467a-450c-9077-73cb176f892c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:23.860354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65978392-467a-450c-9077-73cb176f892c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:23.936496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3d95e-ab63-4db5-9e30-d74c959d4fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:23.937187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3d95e-ab63-4db5-9e30-d74c959d4fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:23.937469 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3d95e-ab63-4db5-9e30-d74c959d4fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:23.937745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3d95e-ab63-4db5-9e30-d74c959d4fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:23.938475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3d95e-ab63-4db5-9e30-d74c959d4fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:23.940436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3d95e-ab63-4db5-9e30-d74c959d4fd9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:23.950630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:24.033215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 984/1968] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:23 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:24.037316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b886b3-2496-403f-b83d-cdc8dd96d068 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:24.044391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:24.047897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b886b3-2496-403f-b83d-cdc8dd96d068 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:24.053559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82902aac-d0a1-44df-9fac-4babd4387687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:24.054521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902aac-d0a1-44df-9fac-4babd4387687 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.054803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902aac-d0a1-44df-9fac-4babd4387687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.055084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82902aac-d0a1-44df-9fac-4babd4387687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.055806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82902aac-d0a1-44df-9fac-4babd4387687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:24.057403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82902aac-d0a1-44df-9fac-4babd4387687 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:24.069255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 985/1969] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:24.073323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3d95e-ab63-4db5-9e30-d74c959d4fd9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:24.083424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3d95e-ab63-4db5-9e30-d74c959d4fd9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:24.087932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0a8f7-a9d6-49da-a435-53007c8ac7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:24.088571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0a8f7-a9d6-49da-a435-53007c8ac7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.088867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0a8f7-a9d6-49da-a435-53007c8ac7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.089123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0a8f7-a9d6-49da-a435-53007c8ac7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.089925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0a8f7-a9d6-49da-a435-53007c8ac7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:24.091597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0a8f7-a9d6-49da-a435-53007c8ac7dd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:24.102531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 985/1970] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:24.106956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82902aac-d0a1-44df-9fac-4babd4387687 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:24.117887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82902aac-d0a1-44df-9fac-4babd4387687 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:24.125838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cc1a4-a8a9-44cb-89e6-a44b695e51d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:24.125838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cc1a4-a8a9-44cb-89e6-a44b695e51d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.125838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cc1a4-a8a9-44cb-89e6-a44b695e51d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.125838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cc1a4-a8a9-44cb-89e6-a44b695e51d2 admin admin] PATH_INFO: `/v3/projects/52c100fecbeb41f7bf1f033b3f35b0b0/users/b07b460eb2b7434187eb37aa22a87384/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.139569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cc1a4-a8a9-44cb-89e6-a44b695e51d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c100fecbeb41f7bf1f033b3f35b0b0, user_id=b07b460eb2b7434187eb37aa22a87384, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:24.142252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872cc1a4-a8a9-44cb-89e6-a44b695e51d2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:24.209517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 986/1971] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:24 2022] PUT /identity/v3/projects/52c100fecbeb41f7bf1f033b3f35b0b0/users/b07b460eb2b7434187eb37aa22a87384/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:24.220281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a5b7a-616b-4ff5-89d0-b0fb85b7f0e4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.220588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a5b7a-616b-4ff5-89d0-b0fb85b7f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.223407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a5b7a-616b-4ff5-89d0-b0fb85b7f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.248117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a25a5b7a-616b-4ff5-89d0-b0fb85b7f0e4 None None] MFA Rules not processed for user `b07b460eb2b7434187eb37aa22a87384`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:24.249333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a25a5b7a-616b-4ff5-89d0-b0fb85b7f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:24.312219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 986/1972] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:24.316719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cc1a4-a8a9-44cb-89e6-a44b695e51d2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:24.376161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872cc1a4-a8a9-44cb-89e6-a44b695e51d2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:24.381106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e3e4-44cb-4f96-aa16-12b7ac94920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:24.381760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e3e4-44cb-4f96-aa16-12b7ac94920c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.382063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e3e4-44cb-4f96-aa16-12b7ac94920c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.382355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e3e4-44cb-4f96-aa16-12b7ac94920c admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.383050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e3e4-44cb-4f96-aa16-12b7ac94920c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:24.384963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e3e4-44cb-4f96-aa16-12b7ac94920c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:24.502218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 987/1973] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:24 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:24.506597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a5b7a-616b-4ff5-89d0-b0fb85b7f0e4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:24.517136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a5b7a-616b-4ff5-89d0-b0fb85b7f0e4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:24.575122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558f31e-66bf-4f03-a6cc-5c2fa8dc7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:24.575790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f31e-66bf-4f03-a6cc-5c2fa8dc7cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.576072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f31e-66bf-4f03-a6cc-5c2fa8dc7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.576349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558f31e-66bf-4f03-a6cc-5c2fa8dc7cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.577039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558f31e-66bf-4f03-a6cc-5c2fa8dc7cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:24.578968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558f31e-66bf-4f03-a6cc-5c2fa8dc7cf8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:24.675755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 987/1974] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:24 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:24.676956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e3e4-44cb-4f96-aa16-12b7ac94920c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:24.687683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e3e4-44cb-4f96-aa16-12b7ac94920c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:24.692558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe53b5-1add-41e9-9115-c0a4fc49faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:24.693212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe53b5-1add-41e9-9115-c0a4fc49faaf admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.693495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe53b5-1add-41e9-9115-c0a4fc49faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.693752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe53b5-1add-41e9-9115-c0a4fc49faaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.694521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe53b5-1add-41e9-9115-c0a4fc49faaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:24.696098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe53b5-1add-41e9-9115-c0a4fc49faaf admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:24.712350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 988/1975] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:24.716258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558f31e-66bf-4f03-a6cc-5c2fa8dc7cf8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:24.726895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558f31e-66bf-4f03-a6cc-5c2fa8dc7cf8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:24.731437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d6ef-6808-405f-9b9f-ec82c3433c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:24.732084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d6ef-6808-405f-9b9f-ec82c3433c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.732372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d6ef-6808-405f-9b9f-ec82c3433c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.732644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d6ef-6808-405f-9b9f-ec82c3433c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.733381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d6ef-6808-405f-9b9f-ec82c3433c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:24.734988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d6ef-6808-405f-9b9f-ec82c3433c8e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:24.745191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 988/1976] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:24.749267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe53b5-1add-41e9-9115-c0a4fc49faaf admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:24.759545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe53b5-1add-41e9-9115-c0a4fc49faaf admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:24.764291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a90f6-b318-4b08-9d61-f2c752a085b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:24.765154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a90f6-b318-4b08-9d61-f2c752a085b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.765436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a90f6-b318-4b08-9d61-f2c752a085b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.765710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a90f6-b318-4b08-9d61-f2c752a085b9 admin admin] PATH_INFO: `/v3/projects/0753777e63d84aee9cd7ae36ad2f5e7c/users/5df04974fa914b4ca9b0585bd5ed259d/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.780340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a90f6-b318-4b08-9d61-f2c752a085b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0753777e63d84aee9cd7ae36ad2f5e7c, user_id=5df04974fa914b4ca9b0585bd5ed259d, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:24.783042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a90f6-b318-4b08-9d61-f2c752a085b9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:24.850011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 989/1977] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:24 2022] PUT /identity/v3/projects/0753777e63d84aee9cd7ae36ad2f5e7c/users/5df04974fa914b4ca9b0585bd5ed259d/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:24.860003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb11f8-251b-4e0f-9d16-c41042e489dc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:24.860296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb11f8-251b-4e0f-9d16-c41042e489dc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:24.860576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb11f8-251b-4e0f-9d16-c41042e489dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:24.887139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-80cb11f8-251b-4e0f-9d16-c41042e489dc None None] MFA Rules not processed for user `5df04974fa914b4ca9b0585bd5ed259d`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:24.888348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-80cb11f8-251b-4e0f-9d16-c41042e489dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:24.929989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:24.955186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 989/1978] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:24.960338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a90f6-b318-4b08-9d61-f2c752a085b9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:25.029779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a90f6-b318-4b08-9d61-f2c752a085b9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:25.034452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622e9f-32eb-4721-8979-a0908df33136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:25.035109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622e9f-32eb-4721-8979-a0908df33136 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:25.035382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622e9f-32eb-4721-8979-a0908df33136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:25.035657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622e9f-32eb-4721-8979-a0908df33136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:25.036344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66622e9f-32eb-4721-8979-a0908df33136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:25.038285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66622e9f-32eb-4721-8979-a0908df33136 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:25.120555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 990/1979] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:24 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:25.132480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb11f8-251b-4e0f-9d16-c41042e489dc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:25.143173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb11f8-251b-4e0f-9d16-c41042e489dc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:25.201171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e1e3-32ce-4699-8894-b85d91b73960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:25.201837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e1e3-32ce-4699-8894-b85d91b73960 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:25.202152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e1e3-32ce-4699-8894-b85d91b73960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:25.202427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9e1e3-32ce-4699-8894-b85d91b73960 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:25.203117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9e1e3-32ce-4699-8894-b85d91b73960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:25.205019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9e1e3-32ce-4699-8894-b85d91b73960 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:25.289891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 990/1980] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:25 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:25.293850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622e9f-32eb-4721-8979-a0908df33136 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:25.301107 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:25.305283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622e9f-32eb-4721-8979-a0908df33136 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:25.309825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90293ff-93ce-4070-b228-dc04570ee20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:25.310628 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90293ff-93ce-4070-b228-dc04570ee20f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:25.310909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90293ff-93ce-4070-b228-dc04570ee20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:25.311218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90293ff-93ce-4070-b228-dc04570ee20f admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:25.311941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90293ff-93ce-4070-b228-dc04570ee20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:25.314498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90293ff-93ce-4070-b228-dc04570ee20f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:25.328980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 991/1981] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:25.330591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e1e3-32ce-4699-8894-b85d91b73960 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:25.341210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9e1e3-32ce-4699-8894-b85d91b73960 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:25.345804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293f9e-c015-48db-a271-f67a7d829d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:25.346760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293f9e-c015-48db-a271-f67a7d829d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:25.347045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293f9e-c015-48db-a271-f67a7d829d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:25.347424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e293f9e-c015-48db-a271-f67a7d829d37 admin admin] PATH_INFO: `/v3/projects/e13760838cd148168c3d8d55a744950d/users/f072251bc49d414493bf3099ef037626/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:25.363123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e293f9e-c015-48db-a271-f67a7d829d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13760838cd148168c3d8d55a744950d, user_id=f072251bc49d414493bf3099ef037626, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:25.365773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e293f9e-c015-48db-a271-f67a7d829d37 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:25.421862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 991/1982] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:25 2022] PUT /identity/v3/projects/e13760838cd148168c3d8d55a744950d/users/f072251bc49d414493bf3099ef037626/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:25.426576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90293ff-93ce-4070-b228-dc04570ee20f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:25.437193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90293ff-93ce-4070-b228-dc04570ee20f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:25.497732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1dc25-6b8d-401a-9918-1cbac1f98a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:25.498423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1dc25-6b8d-401a-9918-1cbac1f98a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:25.498697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1dc25-6b8d-401a-9918-1cbac1f98a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:25.498964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1dc25-6b8d-401a-9918-1cbac1f98a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:25.499677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1dc25-6b8d-401a-9918-1cbac1f98a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:25.501254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1dc25-6b8d-401a-9918-1cbac1f98a0c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:25.511617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 992/1983] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:25.515863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293f9e-c015-48db-a271-f67a7d829d37 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:25.526349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e293f9e-c015-48db-a271-f67a7d829d37 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:25.530929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:25.531787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:25.532068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:25.532337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] PATH_INFO: `/v3/projects/e13760838cd148168c3d8d55a744950d/users/f072251bc49d414493bf3099ef037626/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:25.534449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13760838cd148168c3d8d55a744950d, user_id=f072251bc49d414493bf3099ef037626, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:25.537059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:25.547532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 992/1984] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:25 2022] PUT /identity/v3/projects/e13760838cd148168c3d8d55a744950d/users/f072251bc49d414493bf3099ef037626/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:25.558965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc258bf-8589-41b1-b640-e66867efc7ae None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:25.559377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc258bf-8589-41b1-b640-e66867efc7ae None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:25.559663 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc258bf-8589-41b1-b640-e66867efc7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:25.586994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1bc258bf-8589-41b1-b640-e66867efc7ae None None] MFA Rules not processed for user `f072251bc49d414493bf3099ef037626`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:25.588344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1bc258bf-8589-41b1-b640-e66867efc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:25.662444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 993/1985] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:25.673193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:25.675689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:25.735783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabb150-c459-4f2f-806c-eda10449cb8a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:25.740697 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:25.741339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:25.741620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:25.741894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:25.751574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:25.753280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:25.762950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 993/1986] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:26.987887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc258bf-8589-41b1-b640-e66867efc7ae None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:26.998571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc258bf-8589-41b1-b640-e66867efc7ae None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:27.002118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a28f38-0794-4464-8449-799b866f4263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:27.002753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28f38-0794-4464-8449-799b866f4263 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:27.003096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28f38-0794-4464-8449-799b866f4263 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:27.003591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28f38-0794-4464-8449-799b866f4263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:27.065210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a28f38-0794-4464-8449-799b866f4263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:27.066861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a28f38-0794-4464-8449-799b866f4263 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:27.076031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 994/1987] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:28.032870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:28.035622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:28.116258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:28.171120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6802-0b82-48e8-aefe-84db135a7ca0 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:28.178593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:28.179886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:28.180239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:28.180579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] PATH_INFO: `/v3/users/64ebe59f9fda4aa1b0fa56d40665090f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:28.181944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ebe59f9fda4aa1b0fa56d40665090f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:28.184020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:28.376226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ebe59f9fda4aa1b0fa56d40665090f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:28.456804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ebe59f9fda4aa1b0fa56d40665090f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:28.465491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ebe59f9fda4aa1b0fa56d40665090f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:28.466233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ebe59f9fda4aa1b0fa56d40665090f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:28.489813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ebe59f9fda4aa1b0fa56d40665090f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:28.494633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 994/1988] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:28 2022] DELETE /identity/v3/users/64ebe59f9fda4aa1b0fa56d40665090f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:28.499247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316fef-87fb-4316-af35-df3656126443 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:28.499809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316fef-87fb-4316-af35-df3656126443 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:28.500008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93316fef-87fb-4316-af35-df3656126443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:28.518025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-93316fef-87fb-4316-af35-df3656126443 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:28.520016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-93316fef-87fb-4316-af35-df3656126443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:28.529952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:28.608409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 995/1989] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:28.615622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:28.621458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:28.685981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718f9c4-81e5-408a-9951-ccfc21bf7d57 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:28.689762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7e1b5-3c6b-4eb3-b72b-ea9f1b2cf572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:28.691128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7e1b5-3c6b-4eb3-b72b-ea9f1b2cf572 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:28.691616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7e1b5-3c6b-4eb3-b72b-ea9f1b2cf572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:28.691953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7e1b5-3c6b-4eb3-b72b-ea9f1b2cf572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:28.701371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7e1b5-3c6b-4eb3-b72b-ea9f1b2cf572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:28.702913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7e1b5-3c6b-4eb3-b72b-ea9f1b2cf572 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:28.714166 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 995/1990] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:29.119255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93316fef-87fb-4316-af35-df3656126443 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:29.120650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-93316fef-87fb-4316-af35-df3656126443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:29.132957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93316fef-87fb-4316-af35-df3656126443 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:29.138460 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:29.139443 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:29.139822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:29.140195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] PATH_INFO: `/v3/projects/aae45f09823741dfbff83712f624ddf1` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:29.141593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae45f09823741dfbff83712f624ddf1)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:29.144123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:29.257772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae45f09823741dfbff83712f624ddf1', 'request_id': 'req-a2def325-86e7-4f1a-95f9-6dc009541cda'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.352236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae45f09823741dfbff83712f624ddf1', 'request_id': 'req-a2def325-86e7-4f1a-95f9-6dc009541cda'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.358700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae45f09823741dfbff83712f624ddf1', 'request_id': 'req-a2def325-86e7-4f1a-95f9-6dc009541cda'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.371745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] The token cache is being invalidate because project aae45f09823741dfbff83712f624ddf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:29.372033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.372680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.374462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 996/1991] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:29 2022] DELETE /identity/v3/projects/aae45f09823741dfbff83712f624ddf1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:29.379094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7e1b5-3c6b-4eb3-b72b-ea9f1b2cf572 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:29.388867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7e1b5-3c6b-4eb3-b72b-ea9f1b2cf572 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:29.438797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:29.445148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:29.446059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:29.446343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:29.446617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] PATH_INFO: `/v3/users/cdd5ce49dd674c8aa5638623a0d49491` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:29.447779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd5ce49dd674c8aa5638623a0d49491)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:29.449672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:29.645014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd5ce49dd674c8aa5638623a0d49491'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.746737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd5ce49dd674c8aa5638623a0d49491'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.754566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd5ce49dd674c8aa5638623a0d49491'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.755222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd5ce49dd674c8aa5638623a0d49491'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.767356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd5ce49dd674c8aa5638623a0d49491'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:29.773793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 996/1992] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:29 2022] DELETE /identity/v3/users/cdd5ce49dd674c8aa5638623a0d49491 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:30.446149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:30.447590 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:30.465917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2def325-86e7-4f1a-95f9-6dc009541cda admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:30.561458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:30.562430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:30.562710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:30.562988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] PATH_INFO: `/v3/projects/fd5c1b83996b47278af4db22c764934b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:30.564225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd5c1b83996b47278af4db22c764934b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:30.566356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:30.583483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:30.585119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:30.599888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cfc73-b081-4939-9280-2296b38738c4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:30.604519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:30.605395 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:30.605678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:30.605955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] PATH_INFO: `/v3/users/1a3a656c9e334b0a98afd3a8698d4cfa` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:30.607224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3a656c9e334b0a98afd3a8698d4cfa)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:30.609355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:30.713925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:30.722550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd5c1b83996b47278af4db22c764934b', 'request_id': 'req-62aab9f3-19a6-4bb9-9eee-280b4419259d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.809795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd5c1b83996b47278af4db22c764934b', 'request_id': 'req-62aab9f3-19a6-4bb9-9eee-280b4419259d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.816553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd5c1b83996b47278af4db22c764934b', 'request_id': 'req-62aab9f3-19a6-4bb9-9eee-280b4419259d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.828160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] The token cache is being invalidate because project fd5c1b83996b47278af4db22c764934b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:30.828443 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.829117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.834918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 997/1993] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:30 2022] DELETE /identity/v3/projects/fd5c1b83996b47278af4db22c764934b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:30.841078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:30.841078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:30.848469 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3a656c9e334b0a98afd3a8698d4cfa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.901156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aab9f3-19a6-4bb9-9eee-280b4419259d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:30.905832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:30.906733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:30.907013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:30.907288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] PATH_INFO: `/v3/users/e5d38e44804842b081ad7d0db7040516` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:30.908483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d38e44804842b081ad7d0db7040516)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:30.911051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:30.935629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3a656c9e334b0a98afd3a8698d4cfa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.944261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3a656c9e334b0a98afd3a8698d4cfa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.944999 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3a656c9e334b0a98afd3a8698d4cfa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.958300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9860fc2a-8684-4cf6-8271-686b20ba0637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3a656c9e334b0a98afd3a8698d4cfa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:30.964289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 997/1994] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:30 2022] DELETE /identity/v3/users/1a3a656c9e334b0a98afd3a8698d4cfa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:30.968552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84f081-cc6a-4af1-a8a3-1b72e3a7b820 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:30.968840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84f081-cc6a-4af1-a8a3-1b72e3a7b820 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:30.969118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84f081-cc6a-4af1-a8a3-1b72e3a7b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:30.986435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3e84f081-cc6a-4af1-a8a3-1b72e3a7b820 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:30.988343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3e84f081-cc6a-4af1-a8a3-1b72e3a7b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:31.031984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:31.047591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 998/1995] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:31.060421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84f081-cc6a-4af1-a8a3-1b72e3a7b820 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:31.060421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3e84f081-cc6a-4af1-a8a3-1b72e3a7b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:31.118591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84f081-cc6a-4af1-a8a3-1b72e3a7b820 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:31.122487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:31.123266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:31.123666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:31.124070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:31.134420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:31.135844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:31.140769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d38e44804842b081ad7d0db7040516'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:31.141543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d38e44804842b081ad7d0db7040516'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:31.146113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 999/1996] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:43:31.215805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d38e44804842b081ad7d0db7040516'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:31.235877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d38e44804842b081ad7d0db7040516'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:31.246235 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d38e44804842b081ad7d0db7040516'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:31.254550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 998/1997] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:30 2022] DELETE /identity/v3/users/e5d38e44804842b081ad7d0db7040516 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:31.654782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:31.656819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:31.671532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a294f-e1f6-4352-a70d-17ee71ae8653 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:31.754775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:31.759534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:31.759534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:31.759534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] PATH_INFO: `/v3/projects/2f534944e9114271906c0c88f97dd477` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:31.759534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f534944e9114271906c0c88f97dd477)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:31.760770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:31.799347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:31.801339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:31.818599 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74c5f4-e8ce-4a39-bb77-724758848bd5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:31.828115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:31.828972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:31.829252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:31.829523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] PATH_INFO: `/v3/users/9dbcf7ba67024e25bbb702aec69d2559` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:31.830897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbcf7ba67024e25bbb702aec69d2559)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:31.840937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:31.907726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f534944e9114271906c0c88f97dd477', 'request_id': 'req-9d2f4a28-d000-4d84-ac3d-a37292523442'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.021113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f534944e9114271906c0c88f97dd477', 'request_id': 'req-9d2f4a28-d000-4d84-ac3d-a37292523442'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.027490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f534944e9114271906c0c88f97dd477', 'request_id': 'req-9d2f4a28-d000-4d84-ac3d-a37292523442'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.046532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] The token cache is being invalidate because project 2f534944e9114271906c0c88f97dd477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:32.049485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.049485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.049485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1000/1998] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:31 2022] DELETE /identity/v3/projects/2f534944e9114271906c0c88f97dd477 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:32.050835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.051966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.082768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:32.093805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:32.102131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbcf7ba67024e25bbb702aec69d2559'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.103346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbcf7ba67024e25bbb702aec69d2559'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.132501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f4a28-d000-4d84-ac3d-a37292523442 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.147940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.147940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.147940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.147940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] PATH_INFO: `/v3/projects/25d3d42e59ae4b37bda9660a0efe6cb8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.148321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d3d42e59ae4b37bda9660a0efe6cb8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.149583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:32.187331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbcf7ba67024e25bbb702aec69d2559'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.200955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbcf7ba67024e25bbb702aec69d2559'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.214538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-64d61098-d694-4dae-9011-55763d007b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbcf7ba67024e25bbb702aec69d2559'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.225635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 999/1999] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:31 2022] DELETE /identity/v3/users/9dbcf7ba67024e25bbb702aec69d2559 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:32.228577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086598-088d-4dc7-84f9-ec9e14e3926b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.228577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086598-088d-4dc7-84f9-ec9e14e3926b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.228577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f086598-088d-4dc7-84f9-ec9e14e3926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.266896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8f086598-088d-4dc7-84f9-ec9e14e3926b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:32.268205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8f086598-088d-4dc7-84f9-ec9e14e3926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.288908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d3d42e59ae4b37bda9660a0efe6cb8', 'request_id': 'req-a133527f-976c-46d8-a675-03bb269c617b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.333647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1000/2000] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:32.335446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0d2b-553f-47ff-8281-6c71366c9fe5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.335796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0d2b-553f-47ff-8281-6c71366c9fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.336079 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0d2b-553f-47ff-8281-6c71366c9fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.353734 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f54a0d2b-553f-47ff-8281-6c71366c9fe5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:32.354973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f54a0d2b-553f-47ff-8281-6c71366c9fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.363339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1001/2001] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:32.364106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a0d2b-553f-47ff-8281-6c71366c9fe5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.365284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f54a0d2b-553f-47ff-8281-6c71366c9fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.376547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a0d2b-553f-47ff-8281-6c71366c9fe5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.381828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.385400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.385400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.385400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] PATH_INFO: `/v3/users/fc88352e51be4df694d71a24b897c393` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.385400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc88352e51be4df694d71a24b897c393)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.386308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:32.404171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d3d42e59ae4b37bda9660a0efe6cb8', 'request_id': 'req-a133527f-976c-46d8-a675-03bb269c617b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.412457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d3d42e59ae4b37bda9660a0efe6cb8', 'request_id': 'req-a133527f-976c-46d8-a675-03bb269c617b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.423769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] The token cache is being invalidate because project 25d3d42e59ae4b37bda9660a0efe6cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:32.424055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.425403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a133527f-976c-46d8-a675-03bb269c617b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.427183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1001/2002] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:32 2022] DELETE /identity/v3/projects/25d3d42e59ae4b37bda9660a0efe6cb8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:32.428492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f8be2-5279-4b49-804f-b087dc5d0692 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.428776 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f8be2-5279-4b49-804f-b087dc5d0692 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.429310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f8be2-5279-4b49-804f-b087dc5d0692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.448976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fe8f8be2-5279-4b49-804f-b087dc5d0692 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:32.450237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fe8f8be2-5279-4b49-804f-b087dc5d0692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.458211 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1002/2003] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:32.458989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f8be2-5279-4b49-804f-b087dc5d0692 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.460187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fe8f8be2-5279-4b49-804f-b087dc5d0692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.517867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f8be2-5279-4b49-804f-b087dc5d0692 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.522068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f306f-29de-4385-a937-c19231e1a70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.522756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f306f-29de-4385-a937-c19231e1a70b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.523038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f306f-29de-4385-a937-c19231e1a70b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.523363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f306f-29de-4385-a937-c19231e1a70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.525211 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e68f306f-29de-4385-a937-c19231e1a70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.537430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f306f-29de-4385-a937-c19231e1a70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.538864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f306f-29de-4385-a937-c19231e1a70b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:32.548073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1003/2004] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:32.549246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cf85-19d7-4951-af10-9f2949513303 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.549526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cf85-19d7-4951-af10-9f2949513303 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.550415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43cf85-19d7-4951-af10-9f2949513303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.569367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cd43cf85-19d7-4951-af10-9f2949513303 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:32.570582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cd43cf85-19d7-4951-af10-9f2949513303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.578424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1004/2005] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:32.579193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43cf85-19d7-4951-af10-9f2949513303 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.590668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43cf85-19d7-4951-af10-9f2949513303 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.596098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ef407-cf7c-4625-a63d-16e685b806ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.596825 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef407-cf7c-4625-a63d-16e685b806ce admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.597144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef407-cf7c-4625-a63d-16e685b806ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.597389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef407-cf7c-4625-a63d-16e685b806ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.598219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef407-cf7c-4625-a63d-16e685b806ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:32.598517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef407-cf7c-4625-a63d-16e685b806ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.600113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef407-cf7c-4625-a63d-16e685b806ce admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:32.603689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc88352e51be4df694d71a24b897c393'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.604422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc88352e51be4df694d71a24b897c393'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.612823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1005/2006] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:32.614099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0c057-ef91-41f0-9177-9a3d79840785 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.614392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0c057-ef91-41f0-9177-9a3d79840785 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.614655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0c057-ef91-41f0-9177-9a3d79840785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.634290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a5e0c057-ef91-41f0-9177-9a3d79840785 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:32.635493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a5e0c057-ef91-41f0-9177-9a3d79840785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.644671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1006/2007] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:32.645578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0c057-ef91-41f0-9177-9a3d79840785 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.654757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0c057-ef91-41f0-9177-9a3d79840785 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.659539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ad01-225d-4fb8-ac84-4f514c64b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.660235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ad01-225d-4fb8-ac84-4f514c64b0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.660580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ad01-225d-4fb8-ac84-4f514c64b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.660739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ad01-225d-4fb8-ac84-4f514c64b0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.661488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ad01-225d-4fb8-ac84-4f514c64b0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.663411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ad01-225d-4fb8-ac84-4f514c64b0f2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:32.684129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc88352e51be4df694d71a24b897c393'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.697233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc88352e51be4df694d71a24b897c393'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.703951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc88352e51be4df694d71a24b897c393'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:32.711475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1002/2008] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:32 2022] DELETE /identity/v3/users/fc88352e51be4df694d71a24b897c393 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:32.712286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.713648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.732059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1007/2009] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:32.736201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2616eb-cc86-4c66-b748-c054524d1f84 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.736201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2616eb-cc86-4c66-b748-c054524d1f84 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.736201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2616eb-cc86-4c66-b748-c054524d1f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.752399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3d2616eb-cc86-4c66-b748-c054524d1f84 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:32.754398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3d2616eb-cc86-4c66-b748-c054524d1f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.791506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb08554-a84c-41f3-b589-3abcf3c5037f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.820228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1008/2010] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:32.821111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2616eb-cc86-4c66-b748-c054524d1f84 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.822473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3d2616eb-cc86-4c66-b748-c054524d1f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.836833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2616eb-cc86-4c66-b748-c054524d1f84 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.841983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d9ea5-aa09-4b91-a786-efbd28bb6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.842713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d9ea5-aa09-4b91-a786-efbd28bb6c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.844619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d9ea5-aa09-4b91-a786-efbd28bb6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.844619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d9ea5-aa09-4b91-a786-efbd28bb6c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.844619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d9ea5-aa09-4b91-a786-efbd28bb6c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.847556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d9ea5-aa09-4b91-a786-efbd28bb6c1b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:32.862066 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:32.877425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.878875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.879159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.879433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.880165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:32.880469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.883209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:32.902203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1003/2011] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:32.902203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.903655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:32.925087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:32.953513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1009/2012] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:32.954430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d9ea5-aa09-4b91-a786-efbd28bb6c1b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:32.966086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61711-f84d-41da-aee3-81e90e2ee04a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.969034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d9ea5-aa09-4b91-a786-efbd28bb6c1b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:32.970188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16379-3b7b-46c6-a751-e57fe7990de4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.971141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16379-3b7b-46c6-a751-e57fe7990de4 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.971477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16379-3b7b-46c6-a751-e57fe7990de4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.973030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef16379-3b7b-46c6-a751-e57fe7990de4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.977367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aff2ae-c175-42c8-91fb-35db84ac1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:32.977932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aff2ae-c175-42c8-91fb-35db84ac1dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:32.978228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aff2ae-c175-42c8-91fb-35db84ac1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:32.978499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aff2ae-c175-42c8-91fb-35db84ac1dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:32.982141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aff2ae-c175-42c8-91fb-35db84ac1dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.985178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aff2ae-c175-42c8-91fb-35db84ac1dc6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:32.985381 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef16379-3b7b-46c6-a751-e57fe7990de4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:32.986848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef16379-3b7b-46c6-a751-e57fe7990de4 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.004697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1004/2013] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:33.008410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16379-3b7b-46c6-a751-e57fe7990de4 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.017115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef16379-3b7b-46c6-a751-e57fe7990de4 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.022927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.023596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.023868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.024211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.024906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.030930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.042809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1005/2014] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:33.042809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.044532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.058586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5dc84-221b-4521-a56c-090a5ea37d8b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.063418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.064332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.064615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.064886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] PATH_INFO: `/v3/projects/c82470cba4a7465897c5167d50dc1b97` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.066830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82470cba4a7465897c5167d50dc1b97)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.068804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.114156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1010/2015] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:32 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:33.115079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aff2ae-c175-42c8-91fb-35db84ac1dc6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.176864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aff2ae-c175-42c8-91fb-35db84ac1dc6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.183062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73058a-fbdd-45c2-8393-43cf9608748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.183726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73058a-fbdd-45c2-8393-43cf9608748b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.184009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73058a-fbdd-45c2-8393-43cf9608748b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.184284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef73058a-fbdd-45c2-8393-43cf9608748b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.185015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73058a-fbdd-45c2-8393-43cf9608748b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.186640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef73058a-fbdd-45c2-8393-43cf9608748b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.200714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1011/2016] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:33.200714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73058a-fbdd-45c2-8393-43cf9608748b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.200950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82470cba4a7465897c5167d50dc1b97', 'request_id': 'req-f09616e1-319b-4a72-8433-b6945910557c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.208046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef73058a-fbdd-45c2-8393-43cf9608748b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.274354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.275399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.275399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.275617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.276274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.278498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.289727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82470cba4a7465897c5167d50dc1b97', 'request_id': 'req-f09616e1-319b-4a72-8433-b6945910557c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.297696 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82470cba4a7465897c5167d50dc1b97', 'request_id': 'req-f09616e1-319b-4a72-8433-b6945910557c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.315862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] The token cache is being invalidate because project c82470cba4a7465897c5167d50dc1b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:33.316218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.316968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.318664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1006/2017] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:33 2022] DELETE /identity/v3/projects/c82470cba4a7465897c5167d50dc1b97 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:33.319390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.322564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.335451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09616e1-319b-4a72-8433-b6945910557c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.340500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.341385 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.341661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.341934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] PATH_INFO: `/v3/projects/722f661c6312401b855c408a84d87639/users/bd1e0f88dc7f4eb494dea5d9af86a5f9/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.357997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722f661c6312401b855c408a84d87639, user_id=bd1e0f88dc7f4eb494dea5d9af86a5f9, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.369867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1012/2018] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:33 2022] POST /identity/v3/users => generated 281 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:33.370065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.370197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.370197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.379247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada0763-f62b-4798-805f-ad13e010fc75 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.384234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.385195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.385542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.385905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] PATH_INFO: `/v3/users/fc0aeee21ac941a1ada8656926a7352e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.387135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0aeee21ac941a1ada8656926a7352e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.389092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.450162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:33.458949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1007/2019] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:33 2022] PUT /identity/v3/projects/722f661c6312401b855c408a84d87639/users/bd1e0f88dc7f4eb494dea5d9af86a5f9/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:33.459852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.461513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.501874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:33.529990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a33f5f-27e5-489f-bfc2-d26490c69d43 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.539309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.548090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.548090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.548090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.548090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.548090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.553772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1008/2020] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:33.554855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.556474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.568735 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07858-6711-4eec-a109-e0b746c7ef94 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.573466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.574377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.574656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.574926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] PATH_INFO: `/v3/projects/9b05185695df49178ee95aa260a5b42f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.576083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b05185695df49178ee95aa260a5b42f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.577853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0aeee21ac941a1ada8656926a7352e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.577986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.632398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0aeee21ac941a1ada8656926a7352e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.639766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0aeee21ac941a1ada8656926a7352e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.640420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0aeee21ac941a1ada8656926a7352e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.652828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-581a1fe8-ff55-4903-97ee-f50b4336f6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0aeee21ac941a1ada8656926a7352e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.658842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1013/2021] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:33 2022] DELETE /identity/v3/users/fc0aeee21ac941a1ada8656926a7352e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:33.662986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ace663-401a-4fb0-a005-e0d52f49fdc7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.662986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ace663-401a-4fb0-a005-e0d52f49fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.662986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ace663-401a-4fb0-a005-e0d52f49fdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.689677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c9ace663-401a-4fb0-a005-e0d52f49fdc7 None None] MFA Rules not processed for user `bd1e0f88dc7f4eb494dea5d9af86a5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:33.691746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c9ace663-401a-4fb0-a005-e0d52f49fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.701222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b05185695df49178ee95aa260a5b42f', 'request_id': 'req-ad209cea-e7e9-48b4-97cc-306104abaaba'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.760243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1014/2022] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:33.761285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ace663-401a-4fb0-a005-e0d52f49fdc7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.762639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c9ace663-401a-4fb0-a005-e0d52f49fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.775543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b05185695df49178ee95aa260a5b42f', 'request_id': 'req-ad209cea-e7e9-48b4-97cc-306104abaaba'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.781377 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b05185695df49178ee95aa260a5b42f', 'request_id': 'req-ad209cea-e7e9-48b4-97cc-306104abaaba'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.793413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] The token cache is being invalidate because project 9b05185695df49178ee95aa260a5b42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:33.793703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.794395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:33.795966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1009/2023] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:33 2022] DELETE /identity/v3/projects/9b05185695df49178ee95aa260a5b42f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:33.796728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.797991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.831574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ace663-401a-4fb0-a005-e0d52f49fdc7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.836309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.836963 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.837239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.837509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.838259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.839864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.853222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1015/2024] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:33.853222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.853222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.856669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad209cea-e7e9-48b4-97cc-306104abaaba admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.860286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.860923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.861201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.861475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.864031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.865335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b65ee-5d4d-4fbb-8797-e01619a70cad admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.870093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.870937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.871212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.871488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] PATH_INFO: `/v3/users/ace3bb4d994b4d8a9385a2269c3b41a0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.872654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace3bb4d994b4d8a9385a2269c3b41a0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.874576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.874684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.876056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:33.887284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1010/2025] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:33.888074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:33.889525 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:33.903606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50718440-e28a-49f8-a836-12577c6479ff service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:33.908222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c922ad-7c55-4f71-9cd7-136c63fb377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:33.909748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c922ad-7c55-4f71-9cd7-136c63fb377f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:33.910581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c922ad-7c55-4f71-9cd7-136c63fb377f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:33.910861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c922ad-7c55-4f71-9cd7-136c63fb377f admin admin] PATH_INFO: `/v3/projects/3b9e1baee61b413eb2e00a97c6197c1d/users/25d1b8c7696541bba0f1228f109294fe/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:33.928397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c922ad-7c55-4f71-9cd7-136c63fb377f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9e1baee61b413eb2e00a97c6197c1d, user_id=25d1b8c7696541bba0f1228f109294fe, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:33.931480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c922ad-7c55-4f71-9cd7-136c63fb377f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:34.065569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1011/2026] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:33 2022] PUT /identity/v3/projects/3b9e1baee61b413eb2e00a97c6197c1d/users/25d1b8c7696541bba0f1228f109294fe/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:34.070646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365afd65-da69-4267-a132-5e8222bb0773 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:34.071061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365afd65-da69-4267-a132-5e8222bb0773 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:34.071343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365afd65-da69-4267-a132-5e8222bb0773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:34.101036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-365afd65-da69-4267-a132-5e8222bb0773 None None] MFA Rules not processed for user `25d1b8c7696541bba0f1228f109294fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:34.102545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-365afd65-da69-4267-a132-5e8222bb0773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:34.141058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace3bb4d994b4d8a9385a2269c3b41a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.177045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1012/2027] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:34.212055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365afd65-da69-4267-a132-5e8222bb0773 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:34.213532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-365afd65-da69-4267-a132-5e8222bb0773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:34.221124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace3bb4d994b4d8a9385a2269c3b41a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.232814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:34.235274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace3bb4d994b4d8a9385a2269c3b41a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.236122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace3bb4d994b4d8a9385a2269c3b41a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.251043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace3bb4d994b4d8a9385a2269c3b41a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.258954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1016/2028] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:33 2022] DELETE /identity/v3/users/ace3bb4d994b4d8a9385a2269c3b41a0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:34.259337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:34.260790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:34.289835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365afd65-da69-4267-a132-5e8222bb0773 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:34.318325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:34.341204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c979f-8eca-4f10-a276-40161433b4ea admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:34.345949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:34.347017 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:34.347553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:34.347670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:34.347670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] PATH_INFO: `/v3/projects/f95cbfaa6aee4c98ac7b99b1daefe272` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:34.347846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:34.348755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:34.349164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:34.349277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95cbfaa6aee4c98ac7b99b1daefe272)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:34.351297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:34.357422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:34.418213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:34.419682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:34.429271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1013/2029] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:43:34.444410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:34.446228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:34.472637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09960f3b-9fa4-4b9e-a9fc-820736a3dc3b service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:34.510761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95cbfaa6aee4c98ac7b99b1daefe272', 'request_id': 'req-84cb8f87-b532-49df-9bba-92d6ef9108a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.559833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:34.561595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:34.562082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:34.562538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] PATH_INFO: `/v3/users/25d1b8c7696541bba0f1228f109294fe` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:34.563961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d1b8c7696541bba0f1228f109294fe)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:34.567114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:34.609352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95cbfaa6aee4c98ac7b99b1daefe272', 'request_id': 'req-84cb8f87-b532-49df-9bba-92d6ef9108a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.620399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95cbfaa6aee4c98ac7b99b1daefe272', 'request_id': 'req-84cb8f87-b532-49df-9bba-92d6ef9108a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.634464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] The token cache is being invalidate because project f95cbfaa6aee4c98ac7b99b1daefe272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:34.634756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.635725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84cb8f87-b532-49df-9bba-92d6ef9108a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.641932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1017/2030] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:34 2022] DELETE /identity/v3/projects/f95cbfaa6aee4c98ac7b99b1daefe272 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:34.645502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45d22-0668-47ac-9b67-fc1860f10121 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:34.645502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45d22-0668-47ac-9b67-fc1860f10121 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:34.645502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45d22-0668-47ac-9b67-fc1860f10121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:34.667961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ebf45d22-0668-47ac-9b67-fc1860f10121 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:34.670486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ebf45d22-0668-47ac-9b67-fc1860f10121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:34.681497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1018/2031] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:34.695295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f3ef-9012-4e65-a93a-5647c55c137b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:34.695295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f3ef-9012-4e65-a93a-5647c55c137b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:34.695295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f3ef-9012-4e65-a93a-5647c55c137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:34.714055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f9a0f3ef-9012-4e65-a93a-5647c55c137b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:34.715338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f9a0f3ef-9012-4e65-a93a-5647c55c137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:34.726146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1019/2032] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:34.729059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0f3ef-9012-4e65-a93a-5647c55c137b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:34.738939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0f3ef-9012-4e65-a93a-5647c55c137b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:34.743843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:34.744513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:34.744801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:34.745079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:34.745809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:34.746341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:34.748245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:34.766473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1020/2033] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:34.766473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:34.766473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:34.785165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e28ce6-efd7-4113-a8c8-ed36549cf889 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:34.790428 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:34.791444 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:34.791730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:34.792002 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] PATH_INFO: `/v3/projects/5f8675227c134334bf6fd0f1db91da98` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:34.793823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8675227c134334bf6fd0f1db91da98)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:34.795143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:34.824685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d1b8c7696541bba0f1228f109294fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.825351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d1b8c7696541bba0f1228f109294fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.924403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d1b8c7696541bba0f1228f109294fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.941468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d1b8c7696541bba0f1228f109294fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.944292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8675227c134334bf6fd0f1db91da98', 'request_id': 'req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.948660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d1b8c7696541bba0f1228f109294fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:34.954579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1014/2034] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:34 2022] DELETE /identity/v3/users/25d1b8c7696541bba0f1228f109294fe => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:34.955362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:34.956847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.023725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a443f3-87e8-4bcb-a71a-3aa2e8425f13 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.028376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0cb7d-f5e3-4d24-8a9f-c6fa6cf0549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.029344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0cb7d-f5e3-4d24-8a9f-c6fa6cf0549d admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.029608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0cb7d-f5e3-4d24-8a9f-c6fa6cf0549d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.029889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0cb7d-f5e3-4d24-8a9f-c6fa6cf0549d admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.030623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0cb7d-f5e3-4d24-8a9f-c6fa6cf0549d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.032597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8675227c134334bf6fd0f1db91da98', 'request_id': 'req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:35.032723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0cb7d-f5e3-4d24-8a9f-c6fa6cf0549d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.047764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8675227c134334bf6fd0f1db91da98', 'request_id': 'req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:35.066648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] The token cache is being invalidate because project 5f8675227c134334bf6fd0f1db91da98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:35.067039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:35.067588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:35.069225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1021/2035] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:34 2022] DELETE /identity/v3/projects/5f8675227c134334bf6fd0f1db91da98 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:35.070352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.071274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.128860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1015/2036] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:34 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:35.128860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62c30-375b-41e6-b6d5-8458d77c29b0 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.128860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62c30-375b-41e6-b6d5-8458d77c29b0 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.128860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f62c30-375b-41e6-b6d5-8458d77c29b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.132407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c348a-33d2-4e53-9b74-9fa56d9bcf8e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.149045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-95f62c30-375b-41e6-b6d5-8458d77c29b0 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:35.150315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-95f62c30-375b-41e6-b6d5-8458d77c29b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.186332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.187002 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.187285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.191266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.191266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.218500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1016/2037] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:35.226157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f517c-b73a-4ce9-b1d4-fe6edd8468fc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.226157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f517c-b73a-4ce9-b1d4-fe6edd8468fc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.226157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f517c-b73a-4ce9-b1d4-fe6edd8468fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.245460 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ce1f517c-b73a-4ce9-b1d4-fe6edd8468fc None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:35.246928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ce1f517c-b73a-4ce9-b1d4-fe6edd8468fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.256774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1017/2038] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:35.257951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f517c-b73a-4ce9-b1d4-fe6edd8468fc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.259421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ce1f517c-b73a-4ce9-b1d4-fe6edd8468fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.274356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.275595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f517c-b73a-4ce9-b1d4-fe6edd8468fc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.276249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.281681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65f84d-75fc-40ec-aa33-e6f0fdbf3f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.282771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65f84d-75fc-40ec-aa33-e6f0fdbf3f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.283207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65f84d-75fc-40ec-aa33-e6f0fdbf3f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.283632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65f84d-75fc-40ec-aa33-e6f0fdbf3f8a admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.284933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65f84d-75fc-40ec-aa33-e6f0fdbf3f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.287239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65f84d-75fc-40ec-aa33-e6f0fdbf3f8a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.301601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1022/2039] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:35.303062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.305063 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.381306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07593e2-0646-4e5e-8d7c-b662a99c9981 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.387081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89114fc7-d247-4422-b812-d3eedf7ed756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.387741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89114fc7-d247-4422-b812-d3eedf7ed756 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.388024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89114fc7-d247-4422-b812-d3eedf7ed756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.388293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89114fc7-d247-4422-b812-d3eedf7ed756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.411595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89114fc7-d247-4422-b812-d3eedf7ed756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.411742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1018/2040] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:35 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:35.411826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89114fc7-d247-4422-b812-d3eedf7ed756 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.411900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f027c0-6edd-4531-b6bb-89079a2fdfd4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.411900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f027c0-6edd-4531-b6bb-89079a2fdfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.411900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f027c0-6edd-4531-b6bb-89079a2fdfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.429556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1023/2041] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:35.431042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89114fc7-d247-4422-b812-d3eedf7ed756 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.431163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c8f027c0-6edd-4531-b6bb-89079a2fdfd4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:35.432514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c8f027c0-6edd-4531-b6bb-89079a2fdfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.443088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1019/2042] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:35.443491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89114fc7-d247-4422-b812-d3eedf7ed756 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.447523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f027c0-6edd-4531-b6bb-89079a2fdfd4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.449388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41492f6-9d97-4e77-813b-0cabb7b10cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.449952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41492f6-9d97-4e77-813b-0cabb7b10cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.450614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41492f6-9d97-4e77-813b-0cabb7b10cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.450614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41492f6-9d97-4e77-813b-0cabb7b10cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.451246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41492f6-9d97-4e77-813b-0cabb7b10cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.452830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41492f6-9d97-4e77-813b-0cabb7b10cd5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.458201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f027c0-6edd-4531-b6bb-89079a2fdfd4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.470947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.471654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.472175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.473177 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.473329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1024/2043] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:35.476434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:35.476434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.476434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.477847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41492f6-9d97-4e77-813b-0cabb7b10cd5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.488866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1020/2044] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:43:35.489232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41492f6-9d97-4e77-813b-0cabb7b10cd5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.493203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.497827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b082d-a2f8-4763-a2ec-a8d9e6305c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.498598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b082d-a2f8-4763-a2ec-a8d9e6305c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.498879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b082d-a2f8-4763-a2ec-a8d9e6305c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.499198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b082d-a2f8-4763-a2ec-a8d9e6305c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.500137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b082d-a2f8-4763-a2ec-a8d9e6305c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.502631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b082d-a2f8-4763-a2ec-a8d9e6305c12 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.503846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915306b-b36e-4b6c-ad5b-3c6033457fa5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.509376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.509929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.510481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.510481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.511433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.513781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.514967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1025/2045] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:35.520587 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b082d-a2f8-4763-a2ec-a8d9e6305c12 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.531514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b082d-a2f8-4763-a2ec-a8d9e6305c12 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.538079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450b2a-396d-4005-8a79-513919ecfbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.540247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450b2a-396d-4005-8a79-513919ecfbb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.540597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450b2a-396d-4005-8a79-513919ecfbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.541099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97450b2a-396d-4005-8a79-513919ecfbb6 admin admin] PATH_INFO: `/v3/projects/e709f4494ed544319bcdfe331cf35c4e/users/9fedd8b087374c51860c3190274d84e3/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.557202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450b2a-396d-4005-8a79-513919ecfbb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e709f4494ed544319bcdfe331cf35c4e, user_id=9fedd8b087374c51860c3190274d84e3, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.559956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97450b2a-396d-4005-8a79-513919ecfbb6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.617529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1021/2046] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:35 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:35.618677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.620568 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.632478 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:35.642297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1026/2047] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:35 2022] PUT /identity/v3/projects/e709f4494ed544319bcdfe331cf35c4e/users/9fedd8b087374c51860c3190274d84e3/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:35.644543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450b2a-396d-4005-8a79-513919ecfbb6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.690924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:35.722704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f331fe-0ff8-4cc8-ab81-e8aca99ff293 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.729677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.730655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.731497 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.733717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97450b2a-396d-4005-8a79-513919ecfbb6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.734204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] PATH_INFO: `/v3/users/270785984bc645ec899aeb22a8f9054f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.734204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] RBAC: Authorizing `identity:delete_user(user_id=270785984bc645ec899aeb22a8f9054f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.735096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.743671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d824c82-6d42-4df0-bd91-ddce2659efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.744482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824c82-6d42-4df0-bd91-ddce2659efef admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.744928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824c82-6d42-4df0-bd91-ddce2659efef admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.745573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d824c82-6d42-4df0-bd91-ddce2659efef admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.746826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d824c82-6d42-4df0-bd91-ddce2659efef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.749155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d824c82-6d42-4df0-bd91-ddce2659efef admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:35.863707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1027/2048] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:35 2022] POST /identity/v3/users => generated 282 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:35.865348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc843cb-8d69-4628-a239-42b91ce94ba6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.865644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc843cb-8d69-4628-a239-42b91ce94ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.865924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc843cb-8d69-4628-a239-42b91ce94ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.902624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8fc843cb-8d69-4628-a239-42b91ce94ba6 None None] MFA Rules not processed for user `9fedd8b087374c51860c3190274d84e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:35.903923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8fc843cb-8d69-4628-a239-42b91ce94ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:35.956530 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270785984bc645ec899aeb22a8f9054f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:35.957226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270785984bc645ec899aeb22a8f9054f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:35.971196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1028/2049] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:35.972584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc843cb-8d69-4628-a239-42b91ce94ba6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:35.984496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc843cb-8d69-4628-a239-42b91ce94ba6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:35.989283 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:35.989939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:35.990244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:35.990522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:35.991287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:35.992869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.002893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1029/2050] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:36.003716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.005341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.017907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47690241-387d-481d-a679-27c0ae79e958 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.023857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.024700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.024984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.025315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] PATH_INFO: `/v3/projects/3b9e1baee61b413eb2e00a97c6197c1d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.026553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9e1baee61b413eb2e00a97c6197c1d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.028492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.032483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270785984bc645ec899aeb22a8f9054f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.049212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270785984bc645ec899aeb22a8f9054f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.056655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270785984bc645ec899aeb22a8f9054f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.062694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1022/2051] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:35 2022] DELETE /identity/v3/users/270785984bc645ec899aeb22a8f9054f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:36.063470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.064760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.133507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec7220-591f-4d90-ab43-94a430e4341e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.138448 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500dfc8-412b-4b95-b90f-12453cfe5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.139713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500dfc8-412b-4b95-b90f-12453cfe5cae admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.139713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500dfc8-412b-4b95-b90f-12453cfe5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.139713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500dfc8-412b-4b95-b90f-12453cfe5cae admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.140379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500dfc8-412b-4b95-b90f-12453cfe5cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.142300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500dfc8-412b-4b95-b90f-12453cfe5cae admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.151279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9e1baee61b413eb2e00a97c6197c1d', 'request_id': 'req-8d26e482-84ff-426e-b146-1ffe6717212f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.214323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9e1baee61b413eb2e00a97c6197c1d', 'request_id': 'req-8d26e482-84ff-426e-b146-1ffe6717212f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.220851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9e1baee61b413eb2e00a97c6197c1d', 'request_id': 'req-8d26e482-84ff-426e-b146-1ffe6717212f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.232685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] The token cache is being invalidate because project 3b9e1baee61b413eb2e00a97c6197c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:36.232966 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.233625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.235206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1030/2052] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:36 2022] DELETE /identity/v3/projects/3b9e1baee61b413eb2e00a97c6197c1d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:36.235965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.237271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.249156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1023/2053] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:36.250690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417059f-c232-4233-ad5a-0ca5a55d616d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.250980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417059f-c232-4233-ad5a-0ca5a55d616d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.251255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417059f-c232-4233-ad5a-0ca5a55d616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.270690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6417059f-c232-4233-ad5a-0ca5a55d616d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:36.271906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6417059f-c232-4233-ad5a-0ca5a55d616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.308758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26e482-84ff-426e-b146-1ffe6717212f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.335544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1024/2054] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:36.336781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417059f-c232-4233-ad5a-0ca5a55d616d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.343680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6417059f-c232-4233-ad5a-0ca5a55d616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.356662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417059f-c232-4233-ad5a-0ca5a55d616d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.367631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473db2c6-e251-4e05-ac4b-4953bd34efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.367631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db2c6-e251-4e05-ac4b-4953bd34efb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.367631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db2c6-e251-4e05-ac4b-4953bd34efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.367631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473db2c6-e251-4e05-ac4b-4953bd34efb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.368499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473db2c6-e251-4e05-ac4b-4953bd34efb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.368499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473db2c6-e251-4e05-ac4b-4953bd34efb7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.372575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.373325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.373714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.374024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.374822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.376406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.386708 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1031/2055] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:36.387511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.389146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.401408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce547a9e-2831-4f5a-ba4c-59b62c83ce4a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.405977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.406831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.407115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.407387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] PATH_INFO: `/v3/projects/f60b6521267447fe8b4c12f701a40144` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.408549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60b6521267447fe8b4c12f701a40144)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.411477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.446087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:36.451952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1025/2056] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:36.454222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf529f-8b23-46dc-89b9-f937735078b8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.454222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf529f-8b23-46dc-89b9-f937735078b8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.454222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf529f-8b23-46dc-89b9-f937735078b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.474142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5bbf529f-8b23-46dc-89b9-f937735078b8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:36.475393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5bbf529f-8b23-46dc-89b9-f937735078b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.483396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1026/2057] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:36.484218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf529f-8b23-46dc-89b9-f937735078b8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.493973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf529f-8b23-46dc-89b9-f937735078b8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.499117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3a759-e764-4a80-83e5-0867fa9876db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.500127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a759-e764-4a80-83e5-0867fa9876db admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.500896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a759-e764-4a80-83e5-0867fa9876db admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.501175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a759-e764-4a80-83e5-0867fa9876db admin admin] PATH_INFO: `/v3/projects/51a418abf2664c4fa66de2b6b2913831/users/e0f776cd13f14043b9daee9d947162b0/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.526299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3a759-e764-4a80-83e5-0867fa9876db admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a418abf2664c4fa66de2b6b2913831, user_id=e0f776cd13f14043b9daee9d947162b0, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.529151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3a759-e764-4a80-83e5-0867fa9876db admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.531884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60b6521267447fe8b4c12f701a40144', 'request_id': 'req-472c4cc3-0758-4853-9950-0e68d1309f0c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.608544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60b6521267447fe8b4c12f701a40144', 'request_id': 'req-472c4cc3-0758-4853-9950-0e68d1309f0c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.615619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1027/2058] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:36 2022] PUT /identity/v3/projects/51a418abf2664c4fa66de2b6b2913831/users/e0f776cd13f14043b9daee9d947162b0/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:36.616527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3a759-e764-4a80-83e5-0867fa9876db admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.627157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60b6521267447fe8b4c12f701a40144', 'request_id': 'req-472c4cc3-0758-4853-9950-0e68d1309f0c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.641202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] The token cache is being invalidate because project f60b6521267447fe8b4c12f701a40144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:36.641683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.642352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:36.644075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1032/2059] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:36 2022] DELETE /identity/v3/projects/f60b6521267447fe8b4c12f701a40144 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:36.644734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.648671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.682481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3a759-e764-4a80-83e5-0867fa9876db admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.688906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5077da1-60ab-476e-88f2-1572dd173fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.689565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077da1-60ab-476e-88f2-1572dd173fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.689847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077da1-60ab-476e-88f2-1572dd173fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.690164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077da1-60ab-476e-88f2-1572dd173fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.691636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5077da1-60ab-476e-88f2-1572dd173fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.693487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5077da1-60ab-476e-88f2-1572dd173fdc admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.704086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1028/2060] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:36.705418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3854df-aa14-4299-8aad-8e00eeb36a43 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.705710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3854df-aa14-4299-8aad-8e00eeb36a43 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.706553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3854df-aa14-4299-8aad-8e00eeb36a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.716316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c4cc3-0758-4853-9950-0e68d1309f0c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.720968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1f52a-7a19-4e0d-b302-c3554cc5d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.721828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1f52a-7a19-4e0d-b302-c3554cc5d435 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.721978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1f52a-7a19-4e0d-b302-c3554cc5d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.722390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1f52a-7a19-4e0d-b302-c3554cc5d435 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.723119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1f52a-7a19-4e0d-b302-c3554cc5d435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:36.723503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1f52a-7a19-4e0d-b302-c3554cc5d435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.725578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1f52a-7a19-4e0d-b302-c3554cc5d435 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.733348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9f3854df-aa14-4299-8aad-8e00eeb36a43 None None] MFA Rules not processed for user `e0f776cd13f14043b9daee9d947162b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:36.734608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9f3854df-aa14-4299-8aad-8e00eeb36a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.742405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1033/2061] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:36.742405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231af4cb-35d5-40ad-8fe2-78152a8b44f7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.742405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231af4cb-35d5-40ad-8fe2-78152a8b44f7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.742405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231af4cb-35d5-40ad-8fe2-78152a8b44f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.768150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-231af4cb-35d5-40ad-8fe2-78152a8b44f7 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:36.769739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-231af4cb-35d5-40ad-8fe2-78152a8b44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.784300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1034/2062] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:36.784300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231af4cb-35d5-40ad-8fe2-78152a8b44f7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.784300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:36.790410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-231af4cb-35d5-40ad-8fe2-78152a8b44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.799182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231af4cb-35d5-40ad-8fe2-78152a8b44f7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.805143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee7707-accf-4707-8d62-ccc07b1e153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.806110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7707-accf-4707-8d62-ccc07b1e153d admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.806391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7707-accf-4707-8d62-ccc07b1e153d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.806661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee7707-accf-4707-8d62-ccc07b1e153d admin admin] PATH_INFO: `/v3/projects/a1c50c726017426f84c9fa1eee49cc6f/users/33ef3c2d1c5d44649fb63a2dadc2ece1/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.814980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1029/2063] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:36.817726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3854df-aa14-4299-8aad-8e00eeb36a43 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:36.823057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7707-accf-4707-8d62-ccc07b1e153d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c50c726017426f84c9fa1eee49cc6f, user_id=33ef3c2d1c5d44649fb63a2dadc2ece1, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.825891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee7707-accf-4707-8d62-ccc07b1e153d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.832945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3854df-aa14-4299-8aad-8e00eeb36a43 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:36.836396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3cce0-6b40-4b7c-94f0-131833bb0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:36.837110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3cce0-6b40-4b7c-94f0-131833bb0d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.837667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3cce0-6b40-4b7c-94f0-131833bb0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.838247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3cce0-6b40-4b7c-94f0-131833bb0d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.843414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3cce0-6b40-4b7c-94f0-131833bb0d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:36.843414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3cce0-6b40-4b7c-94f0-131833bb0d3f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:36.917969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1035/2064] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:36 2022] PUT /identity/v3/projects/a1c50c726017426f84c9fa1eee49cc6f/users/33ef3c2d1c5d44649fb63a2dadc2ece1/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:36.919346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d7fe-c351-46c6-aed5-94e6dfc27c9f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.919630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d7fe-c351-46c6-aed5-94e6dfc27c9f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.919906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d7fe-c351-46c6-aed5-94e6dfc27c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.939029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8879d7fe-c351-46c6-aed5-94e6dfc27c9f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:36.941316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8879d7fe-c351-46c6-aed5-94e6dfc27c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:36.945527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1030/2065] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:36.946877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885e7f-fb66-4c74-a4db-04450d20e212 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:36.947166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885e7f-fb66-4c74-a4db-04450d20e212 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:36.947608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885e7f-fb66-4c74-a4db-04450d20e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:36.966215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-52885e7f-fb66-4c74-a4db-04450d20e212 None None] MFA Rules not processed for user `bd1e0f88dc7f4eb494dea5d9af86a5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:36.967416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-52885e7f-fb66-4c74-a4db-04450d20e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:37.014365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1036/2066] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:37.015209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879d7fe-c351-46c6-aed5-94e6dfc27c9f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.016491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8879d7fe-c351-46c6-aed5-94e6dfc27c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:37.031830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879d7fe-c351-46c6-aed5-94e6dfc27c9f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.035852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1031/2067] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:37.042193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52885e7f-fb66-4c74-a4db-04450d20e212 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.107996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0205c7-9f00-47ee-ae96-64490eced994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.109995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0205c7-9f00-47ee-ae96-64490eced994 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.109995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0205c7-9f00-47ee-ae96-64490eced994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.109995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0205c7-9f00-47ee-ae96-64490eced994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.110661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0205c7-9f00-47ee-ae96-64490eced994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.112566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0205c7-9f00-47ee-ae96-64490eced994 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.115669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52885e7f-fb66-4c74-a4db-04450d20e212 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.120483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec56ee-d05d-4fea-9dcb-402272c4c168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.121279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec56ee-d05d-4fea-9dcb-402272c4c168 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.121593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec56ee-d05d-4fea-9dcb-402272c4c168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.121866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec56ee-d05d-4fea-9dcb-402272c4c168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.122630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec56ee-d05d-4fea-9dcb-402272c4c168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.124280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec56ee-d05d-4fea-9dcb-402272c4c168 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.138526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1032/2068] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:37.138526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec56ee-d05d-4fea-9dcb-402272c4c168 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.146450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec56ee-d05d-4fea-9dcb-402272c4c168 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.151103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08fda2-fb55-4eb7-a736-058a5cca0f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.151747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08fda2-fb55-4eb7-a736-058a5cca0f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.152025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08fda2-fb55-4eb7-a736-058a5cca0f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.152298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08fda2-fb55-4eb7-a736-058a5cca0f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.152978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08fda2-fb55-4eb7-a736-058a5cca0f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.154908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08fda2-fb55-4eb7-a736-058a5cca0f70 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.223135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1037/2069] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:37 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:37.223135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0205c7-9f00-47ee-ae96-64490eced994 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.255995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1033/2070] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:37 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:37.257158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08fda2-fb55-4eb7-a736-058a5cca0f70 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.268820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08fda2-fb55-4eb7-a736-058a5cca0f70 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.295497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0205c7-9f00-47ee-ae96-64490eced994 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.301562 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.302255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.302536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.302810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.303531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:37.304155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.305744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.317744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1038/2071] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:37.318704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.330685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3255b7-ef52-4aa6-af44-42b75291b8b8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.337307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefa17b-cf9b-4f86-ab7d-3ea978a6f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.338392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefa17b-cf9b-4f86-ab7d-3ea978a6f642 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.338770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefa17b-cf9b-4f86-ab7d-3ea978a6f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.339135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefa17b-cf9b-4f86-ab7d-3ea978a6f642 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.339279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a177-ea6d-40a1-95b6-db7f74aab6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.342210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefa17b-cf9b-4f86-ab7d-3ea978a6f642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.342332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a177-ea6d-40a1-95b6-db7f74aab6be admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.342332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a177-ea6d-40a1-95b6-db7f74aab6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.342332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43a177-ea6d-40a1-95b6-db7f74aab6be admin admin] PATH_INFO: `/v3/projects/a1c50c726017426f84c9fa1eee49cc6f/users/33ef3c2d1c5d44649fb63a2dadc2ece1/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.343237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefa17b-cf9b-4f86-ab7d-3ea978a6f642 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.343360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43a177-ea6d-40a1-95b6-db7f74aab6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c50c726017426f84c9fa1eee49cc6f, user_id=33ef3c2d1c5d44649fb63a2dadc2ece1, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.345577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43a177-ea6d-40a1-95b6-db7f74aab6be admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.357366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1034/2072] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:37 2022] PUT /identity/v3/projects/a1c50c726017426f84c9fa1eee49cc6f/users/33ef3c2d1c5d44649fb63a2dadc2ece1/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:37.358295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a177-ea6d-40a1-95b6-db7f74aab6be admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.377928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:37.402111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1039/2073] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:37 2022] POST /identity/v3/users => generated 289 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:37.403155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefa17b-cf9b-4f86-ab7d-3ea978a6f642 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.421882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefa17b-cf9b-4f86-ab7d-3ea978a6f642 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.426376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43a177-ea6d-40a1-95b6-db7f74aab6be admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.433407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbab6ab-4454-48cb-9150-4d02092f296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.434106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab6ab-4454-48cb-9150-4d02092f296b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.434389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab6ab-4454-48cb-9150-4d02092f296b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.434667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbab6ab-4454-48cb-9150-4d02092f296b admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.435640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab6ab-4454-48cb-9150-4d02092f296b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.437706 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbab6ab-4454-48cb-9150-4d02092f296b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.449031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1035/2074] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:37.450290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d50cf2-1753-4245-888c-519795b2c1cd None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.450583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d50cf2-1753-4245-888c-519795b2c1cd None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.450861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d50cf2-1753-4245-888c-519795b2c1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.452702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:37.480923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.481709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-01d50cf2-1753-4245-888c-519795b2c1cd None None] MFA Rules not processed for user `33ef3c2d1c5d44649fb63a2dadc2ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:37.481897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.482204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.482500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.483203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.483762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-01d50cf2-1753-4245-888c-519795b2c1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:37.485204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.552644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1036/2075] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:37.553471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d50cf2-1753-4245-888c-519795b2c1cd None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.563261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d50cf2-1753-4245-888c-519795b2c1cd None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.568435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25406-6bed-43ed-b782-9a646bb2f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.569066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25406-6bed-43ed-b782-9a646bb2f191 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.569341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25406-6bed-43ed-b782-9a646bb2f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.569609 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25406-6bed-43ed-b782-9a646bb2f191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.570358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f25406-6bed-43ed-b782-9a646bb2f191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.571953 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f25406-6bed-43ed-b782-9a646bb2f191 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.583707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1037/2076] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:37.588866 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1040/2077] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:37 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:37.588997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25406-6bed-43ed-b782-9a646bb2f191 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.589086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.589086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:37.593832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25406-6bed-43ed-b782-9a646bb2f191 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.659930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067b74-10d3-4e72-8b27-7bd42f5d75b2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.663932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89f6d6-c3a0-4070-8fea-6213f87efb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.665975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f6d6-c3a0-4070-8fea-6213f87efb49 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.666400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f6d6-c3a0-4070-8fea-6213f87efb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.666804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89f6d6-c3a0-4070-8fea-6213f87efb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.685712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffdcdd-d135-4dc8-9c27-5f87ccc60cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.686586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffdcdd-d135-4dc8-9c27-5f87ccc60cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.686875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffdcdd-d135-4dc8-9c27-5f87ccc60cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.687283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffdcdd-d135-4dc8-9c27-5f87ccc60cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.688164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffdcdd-d135-4dc8-9c27-5f87ccc60cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.689773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffdcdd-d135-4dc8-9c27-5f87ccc60cf3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.704763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1038/2078] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:37.704763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffdcdd-d135-4dc8-9c27-5f87ccc60cf3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.716271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffdcdd-d135-4dc8-9c27-5f87ccc60cf3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.723677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3febad-18ea-4567-99a0-abd0c939901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.724522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3febad-18ea-4567-99a0-abd0c939901c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.724681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3febad-18ea-4567-99a0-abd0c939901c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.724956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3febad-18ea-4567-99a0-abd0c939901c admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.725648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3febad-18ea-4567-99a0-abd0c939901c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.728456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3febad-18ea-4567-99a0-abd0c939901c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.745806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:37.750687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89f6d6-c3a0-4070-8fea-6213f87efb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.757788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89f6d6-c3a0-4070-8fea-6213f87efb49 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.769558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1041/2079] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:37.770515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89f6d6-c3a0-4070-8fea-6213f87efb49 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.781582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89f6d6-c3a0-4070-8fea-6213f87efb49 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.788134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c3f06-7eb5-4e38-9a67-93e0f6341adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.789351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c3f06-7eb5-4e38-9a67-93e0f6341adc admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.789733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c3f06-7eb5-4e38-9a67-93e0f6341adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.790132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c3f06-7eb5-4e38-9a67-93e0f6341adc admin admin] PATH_INFO: `/v3/projects/fedf417e5b22450eb4f4729065f64f90/users/80211f2d0968468183e5411671558120/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.814997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c3f06-7eb5-4e38-9a67-93e0f6341adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedf417e5b22450eb4f4729065f64f90, user_id=80211f2d0968468183e5411671558120, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.816702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c3f06-7eb5-4e38-9a67-93e0f6341adc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.826184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:37.870099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1039/2080] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:37 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:37.870099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3febad-18ea-4567-99a0-abd0c939901c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.879387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3febad-18ea-4567-99a0-abd0c939901c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:37.884633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d519-82a6-452f-8484-bc208430db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:37.885517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d519-82a6-452f-8484-bc208430db06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:37.885800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d519-82a6-452f-8484-bc208430db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:37.886110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246d519-82a6-452f-8484-bc208430db06 admin admin] PATH_INFO: `/v3/projects/a0df26a4bec14c4a8916df9f0cfcb9f6/users/43dbf6d5c8d841c79284907196a2caf5/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:37.901775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246d519-82a6-452f-8484-bc208430db06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0df26a4bec14c4a8916df9f0cfcb9f6, user_id=43dbf6d5c8d841c79284907196a2caf5, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:37.904976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246d519-82a6-452f-8484-bc208430db06 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:37.927626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1042/2081] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:37 2022] PUT /identity/v3/projects/fedf417e5b22450eb4f4729065f64f90/users/80211f2d0968468183e5411671558120/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:37.927626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c3f06-7eb5-4e38-9a67-93e0f6341adc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.981136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1040/2082] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:37 2022] PUT /identity/v3/projects/a0df26a4bec14c4a8916df9f0cfcb9f6/users/43dbf6d5c8d841c79284907196a2caf5/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:37.982169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d519-82a6-452f-8484-bc208430db06 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:37.993957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c3f06-7eb5-4e38-9a67-93e0f6341adc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:38.053256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246d519-82a6-452f-8484-bc208430db06 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:38.058269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e65a47-76f0-466b-b0b1-2c776dee28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:38.058929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e65a47-76f0-466b-b0b1-2c776dee28b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.059209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e65a47-76f0-466b-b0b1-2c776dee28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.059483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e65a47-76f0-466b-b0b1-2c776dee28b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.060199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e65a47-76f0-466b-b0b1-2c776dee28b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:38.061939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e65a47-76f0-466b-b0b1-2c776dee28b6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:38.066851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446cdc1-fac0-49a1-8e28-5bf142fdc618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:38.067644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446cdc1-fac0-49a1-8e28-5bf142fdc618 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.068032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446cdc1-fac0-49a1-8e28-5bf142fdc618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.068406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446cdc1-fac0-49a1-8e28-5bf142fdc618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.069260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446cdc1-fac0-49a1-8e28-5bf142fdc618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:38.071060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446cdc1-fac0-49a1-8e28-5bf142fdc618 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:38.078929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1041/2083] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:38.078929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e65a47-76f0-466b-b0b1-2c776dee28b6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:38.087318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1043/2084] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:38.087318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ab73-67b3-40fd-9ce6-e1f57f2167f3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.087318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ab73-67b3-40fd-9ce6-e1f57f2167f3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.087657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e65a47-76f0-466b-b0b1-2c776dee28b6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:38.087750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901ab73-67b3-40fd-9ce6-e1f57f2167f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.092150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:38.093180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.093572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.093949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] PATH_INFO: `/v3/users/9fedd8b087374c51860c3190274d84e3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.095539 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fedd8b087374c51860c3190274d84e3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:38.098195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:38.116862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d901ab73-67b3-40fd-9ce6-e1f57f2167f3 None None] MFA Rules not processed for user `43dbf6d5c8d841c79284907196a2caf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:38.118201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d901ab73-67b3-40fd-9ce6-e1f57f2167f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:38.185140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1044/2085] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:38.186061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901ab73-67b3-40fd-9ce6-e1f57f2167f3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:38.200590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901ab73-67b3-40fd-9ce6-e1f57f2167f3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:38.209155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1c54b-e127-4434-9e26-22808f277343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:38.210269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c54b-e127-4434-9e26-22808f277343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.210617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c54b-e127-4434-9e26-22808f277343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.210959 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c54b-e127-4434-9e26-22808f277343 admin admin] PATH_INFO: `/v3/projects/fedf417e5b22450eb4f4729065f64f90/users/80211f2d0968468183e5411671558120/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.213028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1c54b-e127-4434-9e26-22808f277343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedf417e5b22450eb4f4729065f64f90, user_id=80211f2d0968468183e5411671558120, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:38.216014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1c54b-e127-4434-9e26-22808f277343 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:38.229430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1045/2086] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:38 2022] PUT /identity/v3/projects/fedf417e5b22450eb4f4729065f64f90/users/80211f2d0968468183e5411671558120/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:38.230310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1c54b-e127-4434-9e26-22808f277343 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:38.312483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1c54b-e127-4434-9e26-22808f277343 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:38.318385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:38.319024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.319303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.319573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.320294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:38.321873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:38.324010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fedd8b087374c51860c3190274d84e3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:38.325217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fedd8b087374c51860c3190274d84e3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:38.333150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1046/2087] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:38.334100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:38.336007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:38.353225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:38.387032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fedd8b087374c51860c3190274d84e3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:38.405018 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdd5a-92f2-4583-a4a6-c408ecfbaf9b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:38.411043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fedd8b087374c51860c3190274d84e3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:38.414355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c5e8d-edda-40bb-be6b-c9d193fc7a29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7d46c2766b4481963adefebea94c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:38.415059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c5e8d-edda-40bb-be6b-c9d193fc7a29 service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.415343 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c5e8d-edda-40bb-be6b-c9d193fc7a29 service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.415623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c5e8d-edda-40bb-be6b-c9d193fc7a29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.420359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-04e1e805-6a03-46a1-92b6-199570feafd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fedd8b087374c51860c3190274d84e3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:38.431105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1042/2088] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:38 2022] DELETE /identity/v3/users/9fedd8b087374c51860c3190274d84e3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:38.432912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a53b-437e-42ca-bd07-4bc244cc3ca5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.433438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a53b-437e-42ca-bd07-4bc244cc3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.433816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a53b-437e-42ca-bd07-4bc244cc3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.465445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-caf3a53b-437e-42ca-bd07-4bc244cc3ca5 None None] MFA Rules not processed for user `80211f2d0968468183e5411671558120`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:38.467514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-caf3a53b-437e-42ca-bd07-4bc244cc3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:38.511364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c5e8d-edda-40bb-be6b-c9d193fc7a29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:38.513157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c5e8d-edda-40bb-be6b-c9d193fc7a29 service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:38.524672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1047/2089] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:38.525496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c5e8d-edda-40bb-be6b-c9d193fc7a29 service glance] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:38.536968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c5e8d-edda-40bb-be6b-c9d193fc7a29 service glance] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:38.585516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1043/2090] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:38.586930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab6b0-2d8d-486c-8bee-61c69102a0a9 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.587323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab6b0-2d8d-486c-8bee-61c69102a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.587952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab6b0-2d8d-486c-8bee-61c69102a0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.594483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:38.610360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-376ab6b0-2d8d-486c-8bee-61c69102a0a9 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:38.611748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-376ab6b0-2d8d-486c-8bee-61c69102a0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:38.635696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:38.636599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.636887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.637178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] PATH_INFO: `/v3/projects/3a7373826e4743088ff1d782782b9890/users/2ffacb9e00b8448eb56a233a5d564d0e/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.663916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7373826e4743088ff1d782782b9890, user_id=2ffacb9e00b8448eb56a233a5d564d0e, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:38.666839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:38.683779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1044/2091] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:38.694238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ab6b0-2d8d-486c-8bee-61c69102a0a9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:38.695624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-376ab6b0-2d8d-486c-8bee-61c69102a0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:38.756931 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ab6b0-2d8d-486c-8bee-61c69102a0a9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:38.761659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259290c3-f20d-4d56-bc48-c9ed19fe91f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:38.761659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259290c3-f20d-4d56-bc48-c9ed19fe91f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.761659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259290c3-f20d-4d56-bc48-c9ed19fe91f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.761902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259290c3-f20d-4d56-bc48-c9ed19fe91f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.772220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259290c3-f20d-4d56-bc48-c9ed19fe91f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:38.773673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259290c3-f20d-4d56-bc48-c9ed19fe91f1 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:38.783427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1045/2092] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:43:38.834355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1048/2093] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:38 2022] PUT /identity/v3/projects/3a7373826e4743088ff1d782782b9890/users/2ffacb9e00b8448eb56a233a5d564d0e/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:38.839694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eeb52-9b8b-4393-8962-b9535defdfa8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:38.839980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eeb52-9b8b-4393-8962-b9535defdfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:38.840252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eeb52-9b8b-4393-8962-b9535defdfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:38.860116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8b7eeb52-9b8b-4393-8962-b9535defdfa8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:38.868155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8b7eeb52-9b8b-4393-8962-b9535defdfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:38.936699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1046/2094] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:38.953686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:38.956405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:39.024777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f41779-e638-424d-a873-d5836cc3375e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:39.029154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:39.029868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:39.030232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:39.030591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:39.046321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:39.047785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:39.058588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1049/2095] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:39.112838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:39.147835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eeb52-9b8b-4393-8962-b9535defdfa8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:39.149558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8b7eeb52-9b8b-4393-8962-b9535defdfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:39.218780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eeb52-9b8b-4393-8962-b9535defdfa8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:39.224464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074cff-4827-4fb5-9b4b-850f0363a902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:39.225201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074cff-4827-4fb5-9b4b-850f0363a902 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:39.225633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074cff-4827-4fb5-9b4b-850f0363a902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:39.226128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e074cff-4827-4fb5-9b4b-850f0363a902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:39.297573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074cff-4827-4fb5-9b4b-850f0363a902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:39.299044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e074cff-4827-4fb5-9b4b-850f0363a902 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:39.309642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1047/2096] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:39.376987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:39.380130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:39.408402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfbab7-dd10-4eec-8559-9769a6096b40 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:39.415482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:39.416703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:39.417123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:39.417546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] PATH_INFO: `/v3/projects/e709f4494ed544319bcdfe331cf35c4e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:39.419922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e709f4494ed544319bcdfe331cf35c4e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:39.422702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:39.628226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e709f4494ed544319bcdfe331cf35c4e', 'request_id': 'req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:39.652348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074cff-4827-4fb5-9b4b-850f0363a902 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:39.661535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e074cff-4827-4fb5-9b4b-850f0363a902 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:39.715326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:39.716392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:39.716678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:39.716951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:39.718782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:39.740791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e709f4494ed544319bcdfe331cf35c4e', 'request_id': 'req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:39.750630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e709f4494ed544319bcdfe331cf35c4e', 'request_id': 'req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:39.769564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] The token cache is being invalidate because project e709f4494ed544319bcdfe331cf35c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:39.769907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:39.771070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:39.773071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1050/2097] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:39 2022] DELETE /identity/v3/projects/e709f4494ed544319bcdfe331cf35c4e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:39.776891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:39.778411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:39.791071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:39.792508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:39.804698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1048/2098] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:39.847971 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd5f1e-979f-4dac-a5fa-a6350bcb69b0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:39.852693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:39.853570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:39.871170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:39.871170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] PATH_INFO: `/v3/users/33ef3c2d1c5d44649fb63a2dadc2ece1` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:39.871170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ef3c2d1c5d44649fb63a2dadc2ece1)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:39.871170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:40.043832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ef3c2d1c5d44649fb63a2dadc2ece1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.159302 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:40.220023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ef3c2d1c5d44649fb63a2dadc2ece1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.226979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:40.231791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:40.231891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ef3c2d1c5d44649fb63a2dadc2ece1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.242631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ef3c2d1c5d44649fb63a2dadc2ece1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.249636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:40.257596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41885de8-9eac-49c6-b890-c995e82c2895 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:40.264225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:40.265421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:40.265708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:40.265988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] PATH_INFO: `/v3/users/b07b460eb2b7434187eb37aa22a87384` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:40.267453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07b460eb2b7434187eb37aa22a87384)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:40.270552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-231d4cfc-d0e6-404c-b766-ef79a305d674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ef3c2d1c5d44649fb63a2dadc2ece1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.270804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:40.318776 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1051/2099] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:39 2022] DELETE /identity/v3/users/33ef3c2d1c5d44649fb63a2dadc2ece1 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:40.503170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07b460eb2b7434187eb37aa22a87384'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.504391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07b460eb2b7434187eb37aa22a87384'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.604160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07b460eb2b7434187eb37aa22a87384'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.642258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07b460eb2b7434187eb37aa22a87384'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.660728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07b460eb2b7434187eb37aa22a87384'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:40.667924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1049/2100] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:40 2022] DELETE /identity/v3/users/b07b460eb2b7434187eb37aa22a87384 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:40.673377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae784f-d695-4fdb-91f8-b67b2296992f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:40.673659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae784f-d695-4fdb-91f8-b67b2296992f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:40.675543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae784f-d695-4fdb-91f8-b67b2296992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:40.704760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-28ae784f-d695-4fdb-91f8-b67b2296992f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:40.707593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-28ae784f-d695-4fdb-91f8-b67b2296992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:40.793127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1052/2101] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:40.803658 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:40.805397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:40.822113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae784f-d695-4fdb-91f8-b67b2296992f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:40.824439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-28ae784f-d695-4fdb-91f8-b67b2296992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:40.837720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae784f-d695-4fdb-91f8-b67b2296992f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:40.842728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:40.843825 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:40.848713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:40.848713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] PATH_INFO: `/v3/projects/a1c50c726017426f84c9fa1eee49cc6f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:40.848713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c50c726017426f84c9fa1eee49cc6f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:40.848713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:40.895354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb364a9-a793-4c1a-b501-89e741ebf017 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:40.902069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f9e93-0790-4204-b094-2c9acc4e96f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:40.902779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9e93-0790-4204-b094-2c9acc4e96f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:40.903074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9e93-0790-4204-b094-2c9acc4e96f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:40.903354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f9e93-0790-4204-b094-2c9acc4e96f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:40.914773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f9e93-0790-4204-b094-2c9acc4e96f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:40.916413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f9e93-0790-4204-b094-2c9acc4e96f3 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:40.926857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1050/2102] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:40.996565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c50c726017426f84c9fa1eee49cc6f', 'request_id': 'req-f459e1e2-2406-4caf-993d-4ff217ffdfeb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.068075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c50c726017426f84c9fa1eee49cc6f', 'request_id': 'req-f459e1e2-2406-4caf-993d-4ff217ffdfeb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.074391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c50c726017426f84c9fa1eee49cc6f', 'request_id': 'req-f459e1e2-2406-4caf-993d-4ff217ffdfeb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.085861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] The token cache is being invalidate because project a1c50c726017426f84c9fa1eee49cc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:41.086179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.086878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f459e1e2-2406-4caf-993d-4ff217ffdfeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.088450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1053/2103] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:40 2022] DELETE /identity/v3/projects/a1c50c726017426f84c9fa1eee49cc6f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:41.093452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412a3a-1239-4b26-aef1-3b3c8209e088 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:41.093738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412a3a-1239-4b26-aef1-3b3c8209e088 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:41.094031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12412a3a-1239-4b26-aef1-3b3c8209e088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:41.146298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-12412a3a-1239-4b26-aef1-3b3c8209e088 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:41.152667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-12412a3a-1239-4b26-aef1-3b3c8209e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:41.280295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1051/2104] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:41.288393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0d86-ce22-4e0a-adc6-be156db6c872 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:41.288685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0d86-ce22-4e0a-adc6-be156db6c872 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:41.289009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0d86-ce22-4e0a-adc6-be156db6c872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:41.308908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bdee0d86-ce22-4e0a-adc6-be156db6c872 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:41.310153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bdee0d86-ce22-4e0a-adc6-be156db6c872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:41.329742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1054/2105] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:41.336821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412a3a-1239-4b26-aef1-3b3c8209e088 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:41.355992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12412a3a-1239-4b26-aef1-3b3c8209e088 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:41.363531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:41.365623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:41.366065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:41.366442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:41.367322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:41.367681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:41.369476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:41.392218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0d86-ce22-4e0a-adc6-be156db6c872 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:41.394692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bdee0d86-ce22-4e0a-adc6-be156db6c872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:41.406391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1052/2106] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:43:41.415052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:41.419379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0d86-ce22-4e0a-adc6-be156db6c872 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:41.428491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:41.429766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:41.430469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97314c-bb06-4a61-b078-821a2a26efd4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:41.430847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:41.432338 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] PATH_INFO: `/v3/projects/52c100fecbeb41f7bf1f033b3f35b0b0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:41.434499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c100fecbeb41f7bf1f033b3f35b0b0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:41.435687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8ac09-1a9c-4b34-975d-31b714c2ff20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:41.437968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8ac09-1a9c-4b34-975d-31b714c2ff20 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:41.438355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8ac09-1a9c-4b34-975d-31b714c2ff20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:41.438635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8ac09-1a9c-4b34-975d-31b714c2ff20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:41.439178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:41.439345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8ac09-1a9c-4b34-975d-31b714c2ff20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:41.442085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8ac09-1a9c-4b34-975d-31b714c2ff20 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:41.587053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1053/2107] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:41 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:41.591082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8ac09-1a9c-4b34-975d-31b714c2ff20 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:41.611215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c100fecbeb41f7bf1f033b3f35b0b0', 'request_id': 'req-ee7ea004-c9e6-4028-813c-beb0e7af2c85'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.683494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c100fecbeb41f7bf1f033b3f35b0b0', 'request_id': 'req-ee7ea004-c9e6-4028-813c-beb0e7af2c85'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.691107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c100fecbeb41f7bf1f033b3f35b0b0', 'request_id': 'req-ee7ea004-c9e6-4028-813c-beb0e7af2c85'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.692957 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8ac09-1a9c-4b34-975d-31b714c2ff20 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:41.717027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] The token cache is being invalidate because project 52c100fecbeb41f7bf1f033b3f35b0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:41.717335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.718045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:41.719621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1055/2108] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:41 2022] DELETE /identity/v3/projects/52c100fecbeb41f7bf1f033b3f35b0b0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:41.724300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:41.728317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:41.747238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:41.788401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:41.789333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:41.790441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:41.791034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:41.791807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:41.795913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:41.828589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea004-c9e6-4028-813c-beb0e7af2c85 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:41.834149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:41.835097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:41.835481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:41.835760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] PATH_INFO: `/v3/users/5df04974fa914b4ca9b0585bd5ed259d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:41.836987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df04974fa914b4ca9b0585bd5ed259d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:41.838963 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:41.925404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1054/2109] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:41 2022] POST /identity/v3/users => generated 292 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:41.931214 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:41.934108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:41.965095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c186-a2be-4b46-a29f-a8de241b4441 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:41.970105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918510-e783-42c5-90ed-1acb03de44b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:41.971056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918510-e783-42c5-90ed-1acb03de44b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:41.972217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918510-e783-42c5-90ed-1acb03de44b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:41.972561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918510-e783-42c5-90ed-1acb03de44b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:41.973470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65918510-e783-42c5-90ed-1acb03de44b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:41.975110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65918510-e783-42c5-90ed-1acb03de44b4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:41.993683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1055/2110] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:41.995514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918510-e783-42c5-90ed-1acb03de44b4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:42.006294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918510-e783-42c5-90ed-1acb03de44b4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:42.012790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ead777-149c-43e9-a6c9-61c522f09573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:42.013566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead777-149c-43e9-a6c9-61c522f09573 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:42.013900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead777-149c-43e9-a6c9-61c522f09573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:42.014254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ead777-149c-43e9-a6c9-61c522f09573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:42.015049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ead777-149c-43e9-a6c9-61c522f09573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:42.016692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ead777-149c-43e9-a6c9-61c522f09573 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:42.027793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1056/2111] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:42.032040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ead777-149c-43e9-a6c9-61c522f09573 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:42.034360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:42.045625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ead777-149c-43e9-a6c9-61c522f09573 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:42.051212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52234455-4111-4281-89c9-e442bca7334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:42.052836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52234455-4111-4281-89c9-e442bca7334c admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:42.053140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52234455-4111-4281-89c9-e442bca7334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:42.053414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52234455-4111-4281-89c9-e442bca7334c admin admin] PATH_INFO: `/v3/projects/bfe2dfb0580c4cd3aff9345df536adb5/users/dd6088c9a0694772911360f1f6c887ec/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:42.071314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52234455-4111-4281-89c9-e442bca7334c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe2dfb0580c4cd3aff9345df536adb5, user_id=dd6088c9a0694772911360f1f6c887ec, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:42.074473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52234455-4111-4281-89c9-e442bca7334c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:42.148232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df04974fa914b4ca9b0585bd5ed259d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:42.183854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1057/2112] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:42 2022] PUT /identity/v3/projects/bfe2dfb0580c4cd3aff9345df536adb5/users/dd6088c9a0694772911360f1f6c887ec/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:42.194599 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c0426-2c55-4c1b-a1d4-b51d58f4b74b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:42.195000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c0426-2c55-4c1b-a1d4-b51d58f4b74b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:42.195341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c0426-2c55-4c1b-a1d4-b51d58f4b74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:42.246535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b66c0426-2c55-4c1b-a1d4-b51d58f4b74b None None] MFA Rules not processed for user `dd6088c9a0694772911360f1f6c887ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:42.248216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b66c0426-2c55-4c1b-a1d4-b51d58f4b74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:42.264835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df04974fa914b4ca9b0585bd5ed259d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:42.288286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df04974fa914b4ca9b0585bd5ed259d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:42.289362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df04974fa914b4ca9b0585bd5ed259d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:42.330320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df04974fa914b4ca9b0585bd5ed259d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:42.346509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1056/2113] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:41 2022] DELETE /identity/v3/users/5df04974fa914b4ca9b0585bd5ed259d => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:42.397329 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1058/2114] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:42.402959 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:42.404801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:42.529038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f663d9-716a-4d80-84f2-cb33f84fe67d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:42.534688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:42.536632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:42.536632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:42.536832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:42.537429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:42.539672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:42.669929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1057/2115] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:42 2022] POST /identity/v3/projects => generated 383 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:42.673590 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c0426-2c55-4c1b-a1d4-b51d58f4b74b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:42.800795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c0426-2c55-4c1b-a1d4-b51d58f4b74b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:42.915051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce894-b2af-4117-809f-33654e1fbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:42.916260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce894-b2af-4117-809f-33654e1fbc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:42.916647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce894-b2af-4117-809f-33654e1fbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:42.916912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ce894-b2af-4117-809f-33654e1fbc28 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:42.917624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ce894-b2af-4117-809f-33654e1fbc28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:42.919592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ce894-b2af-4117-809f-33654e1fbc28 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:42.981785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:42.983917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:43.024197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d9637-57b1-454f-a793-60f77733ba1d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:43.027530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:43.028618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:43.028896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:43.029170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] PATH_INFO: `/v3/projects/0753777e63d84aee9cd7ae36ad2f5e7c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:43.032159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0753777e63d84aee9cd7ae36ad2f5e7c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:43.035233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:43.050648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1059/2116] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:42 2022] POST /identity/v3/users => generated 298 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:43.054631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce894-b2af-4117-809f-33654e1fbc28 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:43.075664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ce894-b2af-4117-809f-33654e1fbc28 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:43.094955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c726f-bc01-4279-9abb-5ed3c2030a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:43.096052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c726f-bc01-4279-9abb-5ed3c2030a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:43.097076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c726f-bc01-4279-9abb-5ed3c2030a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:43.097559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c726f-bc01-4279-9abb-5ed3c2030a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:43.098703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c726f-bc01-4279-9abb-5ed3c2030a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:43.100989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c726f-bc01-4279-9abb-5ed3c2030a2c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:43.114311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1060/2117] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:43.119089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c726f-bc01-4279-9abb-5ed3c2030a2c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:43.131510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c726f-bc01-4279-9abb-5ed3c2030a2c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:43.136356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae39501-b3db-49b2-8ae8-490e7215c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:43.137263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae39501-b3db-49b2-8ae8-490e7215c609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:43.137548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae39501-b3db-49b2-8ae8-490e7215c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:43.137822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae39501-b3db-49b2-8ae8-490e7215c609 admin admin] PATH_INFO: `/v3/projects/4f64b986f7834789bd26e7ec16cb7fe1/users/25bb0b615b5740eaab6b803b80b23757/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:43.157954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae39501-b3db-49b2-8ae8-490e7215c609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f64b986f7834789bd26e7ec16cb7fe1, user_id=25bb0b615b5740eaab6b803b80b23757, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:43.161664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae39501-b3db-49b2-8ae8-490e7215c609 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:43.176218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0753777e63d84aee9cd7ae36ad2f5e7c', 'request_id': 'req-3483da1e-f44d-492a-ad9e-b5a9e133e183'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.232982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:43.261176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0753777e63d84aee9cd7ae36ad2f5e7c', 'request_id': 'req-3483da1e-f44d-492a-ad9e-b5a9e133e183'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.269145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0753777e63d84aee9cd7ae36ad2f5e7c', 'request_id': 'req-3483da1e-f44d-492a-ad9e-b5a9e133e183'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.273731 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1061/2118] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:43 2022] PUT /identity/v3/projects/4f64b986f7834789bd26e7ec16cb7fe1/users/25bb0b615b5740eaab6b803b80b23757/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:43.278354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae39501-b3db-49b2-8ae8-490e7215c609 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:43.286082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] The token cache is being invalidate because project 0753777e63d84aee9cd7ae36ad2f5e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:43.286577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.287471 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.290170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1058/2119] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:42 2022] DELETE /identity/v3/projects/0753777e63d84aee9cd7ae36ad2f5e7c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:43.294161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:43.295859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:43.375747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae39501-b3db-49b2-8ae8-490e7215c609 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:43.381590 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:43.382312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:43.382595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:43.382873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:43.383615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:43.385456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:43.412031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1062/2120] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:43.415842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:43.416336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483da1e-f44d-492a-ad9e-b5a9e133e183 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:43.421985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:43.423071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:43.423503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:43.425815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] PATH_INFO: `/v3/users/f072251bc49d414493bf3099ef037626` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:43.426703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f072251bc49d414493bf3099ef037626)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:43.427958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:43.428996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:43.455438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768f8f5-da73-4f21-b3fc-e18fc1775d28 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:43.462213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25470f-bbce-4efb-8d01-6b91e5a449ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:43.466582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25470f-bbce-4efb-8d01-6b91e5a449ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:43.466868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25470f-bbce-4efb-8d01-6b91e5a449ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:43.467145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25470f-bbce-4efb-8d01-6b91e5a449ed admin admin] PATH_INFO: `/v3/projects/4f64b986f7834789bd26e7ec16cb7fe1/users/25bb0b615b5740eaab6b803b80b23757/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:43.470481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25470f-bbce-4efb-8d01-6b91e5a449ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f64b986f7834789bd26e7ec16cb7fe1, user_id=25bb0b615b5740eaab6b803b80b23757, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:43.473318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25470f-bbce-4efb-8d01-6b91e5a449ed admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:43.485815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1063/2121] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:43 2022] PUT /identity/v3/projects/4f64b986f7834789bd26e7ec16cb7fe1/users/25bb0b615b5740eaab6b803b80b23757/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:43.496279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf4b1a-f9d6-4213-821c-2f09972fd5de None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:43.496673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf4b1a-f9d6-4213-821c-2f09972fd5de None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:43.497075 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf4b1a-f9d6-4213-821c-2f09972fd5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:43.531311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f8cf4b1a-f9d6-4213-821c-2f09972fd5de None None] MFA Rules not processed for user `25bb0b615b5740eaab6b803b80b23757`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:43.535801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f8cf4b1a-f9d6-4213-821c-2f09972fd5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:43.642072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1064/2122] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:43.655426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf4b1a-f9d6-4213-821c-2f09972fd5de None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:43.656843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f8cf4b1a-f9d6-4213-821c-2f09972fd5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:43.722644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f072251bc49d414493bf3099ef037626'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.747131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf4b1a-f9d6-4213-821c-2f09972fd5de None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:43.757692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:43.759246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:43.759621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:43.759948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:43.781467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:43.783193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:43.802238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1065/2123] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:43.834448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f072251bc49d414493bf3099ef037626'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.847373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f072251bc49d414493bf3099ef037626'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.848177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f072251bc49d414493bf3099ef037626'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.869115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f072251bc49d414493bf3099ef037626'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:43.880529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1059/2124] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:43 2022] DELETE /identity/v3/users/f072251bc49d414493bf3099ef037626 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:43.975838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:44.074872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:44.076515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:44.079006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:44.081318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:44.173872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2be1c3-e91f-4713-9a7a-1e21f96f3370 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:44.191224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:44.194217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:44.194946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:44.196253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:44.197907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dafeda-ace0-40cb-af31-9d65f9d3f0b2 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:44.203038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:44.284967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:44.324305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:44.326956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:44.327964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:44.328348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] PATH_INFO: `/v3/users/e0f776cd13f14043b9daee9d947162b0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:44.332246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f776cd13f14043b9daee9d947162b0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:44.338415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:44.344307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:44.346023 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:44.369793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1060/2125] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:43:44.492655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:44.668629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f776cd13f14043b9daee9d947162b0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:44.669308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f776cd13f14043b9daee9d947162b0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:44.711852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:44.712757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:44.735710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e397b7-638f-4f1f-bd7c-5a12de870090 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:44.745235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:44.746835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f776cd13f14043b9daee9d947162b0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:44.747841 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:44.748238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:44.749853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] PATH_INFO: `/v3/projects/e13760838cd148168c3d8d55a744950d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:44.753700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13760838cd148168c3d8d55a744950d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:44.758851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:44.765494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f776cd13f14043b9daee9d947162b0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:44.779006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-635ee798-0471-4f8f-87f0-896fb15d56a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f776cd13f14043b9daee9d947162b0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:44.798644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1066/2126] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:44 2022] DELETE /identity/v3/users/e0f776cd13f14043b9daee9d947162b0 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:44.803529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda48f-89e1-4e9e-859f-372517a2d5be None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:44.804074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda48f-89e1-4e9e-859f-372517a2d5be None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:44.804352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcda48f-89e1-4e9e-859f-372517a2d5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:44.835215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cdcda48f-89e1-4e9e-859f-372517a2d5be None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:44.836442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cdcda48f-89e1-4e9e-859f-372517a2d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:44.919155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13760838cd148168c3d8d55a744950d', 'request_id': 'req-fc0d2809-4e08-40f7-a110-82a099a9c9b1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:44.946053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1067/2127] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:44.966783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcda48f-89e1-4e9e-859f-372517a2d5be None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:44.975890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cdcda48f-89e1-4e9e-859f-372517a2d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:44.990145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13760838cd148168c3d8d55a744950d', 'request_id': 'req-fc0d2809-4e08-40f7-a110-82a099a9c9b1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.004251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13760838cd148168c3d8d55a744950d', 'request_id': 'req-fc0d2809-4e08-40f7-a110-82a099a9c9b1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.043607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] The token cache is being invalidate because project e13760838cd148168c3d8d55a744950d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:45.044194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.047429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc0d2809-4e08-40f7-a110-82a099a9c9b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.047429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1061/2128] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:44 2022] DELETE /identity/v3/projects/e13760838cd148168c3d8d55a744950d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:45.060272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748abb-35e4-4f64-8252-f6deef2f6eba None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.060272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748abb-35e4-4f64-8252-f6deef2f6eba None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.060272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d748abb-35e4-4f64-8252-f6deef2f6eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.092180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcda48f-89e1-4e9e-859f-372517a2d5be None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:45.116548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8d748abb-35e4-4f64-8252-f6deef2f6eba None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:45.119351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8d748abb-35e4-4f64-8252-f6deef2f6eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:45.191808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:45.193904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.194221 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.194502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.201672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:45.211692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1062/2129] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:45.219908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484b678-f1c7-4106-ae41-9129ececd8ce None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.219908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484b678-f1c7-4106-ae41-9129ececd8ce None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.220167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484b678-f1c7-4106-ae41-9129ececd8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.224457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:45.226648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:45.267035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1068/2130] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:43:45.280632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7484b678-f1c7-4106-ae41-9129ececd8ce None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:45.281969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7484b678-f1c7-4106-ae41-9129ececd8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:45.287796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:45.289105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:45.298238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1063/2131] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:45.300020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484b678-f1c7-4106-ae41-9129ececd8ce None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:45.304533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3508e-713e-4dbf-a549-e310cb3ff7b5 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:45.309890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484b678-f1c7-4106-ae41-9129ececd8ce None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:45.310665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:45.311831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.312064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.312341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] PATH_INFO: `/v3/users/dd6088c9a0694772911360f1f6c887ec` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.313560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6088c9a0694772911360f1f6c887ec)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:45.315518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:45.315810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:45.316779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.317154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.317531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.318410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:45.318830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:45.320840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:45.343360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1064/2132] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:45.349109 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:45.361191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1256e-ede6-4a5c-92c0-bdfe5e410389 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:45.368043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b592de-f9f3-4c9b-9b80-71d45701fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:45.368809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b592de-f9f3-4c9b-9b80-71d45701fb8b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.373239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b592de-f9f3-4c9b-9b80-71d45701fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.373239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b592de-f9f3-4c9b-9b80-71d45701fb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.373239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b592de-f9f3-4c9b-9b80-71d45701fb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:45.373239 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b592de-f9f3-4c9b-9b80-71d45701fb8b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:45.517319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1065/2133] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:45 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:45.519014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b592de-f9f3-4c9b-9b80-71d45701fb8b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:45.571686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:45.586705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6088c9a0694772911360f1f6c887ec'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.586705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6088c9a0694772911360f1f6c887ec'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.620900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b592de-f9f3-4c9b-9b80-71d45701fb8b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:45.620900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:45.621104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.621494 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.621777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.622507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:45.624719 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:45.673053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6088c9a0694772911360f1f6c887ec'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.687384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6088c9a0694772911360f1f6c887ec'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.696151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d5ea752f-4a0a-457b-9961-2085fd1cd252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6088c9a0694772911360f1f6c887ec'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:45.714407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1069/2134] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:45 2022] DELETE /identity/v3/users/dd6088c9a0694772911360f1f6c887ec => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:45.719233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049153-562b-451b-94a5-818a60906b58 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.719594 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049153-562b-451b-94a5-818a60906b58 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.719939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049153-562b-451b-94a5-818a60906b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.740133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-24049153-562b-451b-94a5-818a60906b58 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:45.742290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-24049153-562b-451b-94a5-818a60906b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:45.743513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1066/2135] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:45 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:45.747340 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:45.750150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:45.771132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a9578-7393-484b-b393-d5413807dcc0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:45.804883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:45.896261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1070/2136] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:45.906942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049153-562b-451b-94a5-818a60906b58 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:45.909435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-24049153-562b-451b-94a5-818a60906b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:45.918188 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93fe25-0f64-48f9-931a-b9b7356dbe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:45.925522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fe25-0f64-48f9-931a-b9b7356dbe7b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.925522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fe25-0f64-48f9-931a-b9b7356dbe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.925522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93fe25-0f64-48f9-931a-b9b7356dbe7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.925522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93fe25-0f64-48f9-931a-b9b7356dbe7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:45.925522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93fe25-0f64-48f9-931a-b9b7356dbe7b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:45.941718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1067/2137] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:45.946497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93fe25-0f64-48f9-931a-b9b7356dbe7b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:45.963310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93fe25-0f64-48f9-931a-b9b7356dbe7b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:45.974345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:45.974345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:45.974345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:45.974345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:45.975382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:45.979114 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:46.008624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1068/2138] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:46.011264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:46.015263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:46.048011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049153-562b-451b-94a5-818a60906b58 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:46.056498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc729a-24ad-425f-81fe-258a1c0a6c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:46.057423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc729a-24ad-425f-81fe-258a1c0a6c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:46.060429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc729a-24ad-425f-81fe-258a1c0a6c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:46.060810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc729a-24ad-425f-81fe-258a1c0a6c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:46.076263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c4965-b2eb-4822-a264-b25d4bda4f8b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:46.082676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc729a-24ad-425f-81fe-258a1c0a6c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:46.087090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc729a-24ad-425f-81fe-258a1c0a6c15 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:46.090299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:46.091288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:46.091639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:46.093033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] PATH_INFO: `/v3/projects/51a418abf2664c4fa66de2b6b2913831` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:46.096616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a418abf2664c4fa66de2b6b2913831)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:46.100516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:46.117191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1071/2139] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:46.136210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc729a-24ad-425f-81fe-258a1c0a6c15 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:46.168698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc729a-24ad-425f-81fe-258a1c0a6c15 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:46.180998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c0675-2fc6-46b8-bd6c-837af6e08a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:46.181800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c0675-2fc6-46b8-bd6c-837af6e08a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:46.182126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c0675-2fc6-46b8-bd6c-837af6e08a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:46.182940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c0675-2fc6-46b8-bd6c-837af6e08a18 admin admin] PATH_INFO: `/v3/projects/55d78f08740d4920baa9cb3ed2588534/users/00b88924d4de4ccea29e45716a128469/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:46.206124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c0675-2fc6-46b8-bd6c-837af6e08a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d78f08740d4920baa9cb3ed2588534, user_id=00b88924d4de4ccea29e45716a128469, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:46.211317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c0675-2fc6-46b8-bd6c-837af6e08a18 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:46.321170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1072/2140] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:46 2022] PUT /identity/v3/projects/55d78f08740d4920baa9cb3ed2588534/users/00b88924d4de4ccea29e45716a128469/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:46.336024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2c0f-a135-42b2-b8c3-8ace15af9e19 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:46.336661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2c0f-a135-42b2-b8c3-8ace15af9e19 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:46.337179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2c0f-a135-42b2-b8c3-8ace15af9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:46.345427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a418abf2664c4fa66de2b6b2913831', 'request_id': 'req-aed1748c-0d79-4d07-8249-fda2078ebd55'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.369745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fb4e2c0f-a135-42b2-b8c3-8ace15af9e19 None None] MFA Rules not processed for user `00b88924d4de4ccea29e45716a128469`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:46.371317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fb4e2c0f-a135-42b2-b8c3-8ace15af9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:46.414672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a418abf2664c4fa66de2b6b2913831', 'request_id': 'req-aed1748c-0d79-4d07-8249-fda2078ebd55'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.426578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a418abf2664c4fa66de2b6b2913831', 'request_id': 'req-aed1748c-0d79-4d07-8249-fda2078ebd55'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.463788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] The token cache is being invalidate because project 51a418abf2664c4fa66de2b6b2913831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:46.467001 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.471862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.475254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1069/2141] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:46 2022] DELETE /identity/v3/projects/51a418abf2664c4fa66de2b6b2913831 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:46.479089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:46.482112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:46.490888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1073/2142] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:46.493731 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2c0f-a135-42b2-b8c3-8ace15af9e19 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:46.626163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2c0f-a135-42b2-b8c3-8ace15af9e19 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:46.631850 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:46.632651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:46.632931 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:46.633203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:46.634149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:46.636333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:46.638493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1748c-0d79-4d07-8249-fda2078ebd55 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:46.648807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:46.650096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:46.650380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:46.650652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] PATH_INFO: `/v3/users/80211f2d0968468183e5411671558120` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:46.651923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80211f2d0968468183e5411671558120)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:46.653979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:46.758951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1074/2143] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:46 2022] POST /identity/v3/projects => generated 383 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:46.760001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:46.764130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:46.863997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80211f2d0968468183e5411671558120'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.894773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ac12f-d3b8-46e9-854f-1203ed038229 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:46.905329 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:46.906273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:46.906553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:46.906828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] PATH_INFO: `/v3/projects/bfe2dfb0580c4cd3aff9345df536adb5` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:46.908097 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe2dfb0580c4cd3aff9345df536adb5)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:46.911382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:46.960621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80211f2d0968468183e5411671558120'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.969665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80211f2d0968468183e5411671558120'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.970571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80211f2d0968468183e5411671558120'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:46.996233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80211f2d0968468183e5411671558120'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.030079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1070/2144] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:46 2022] DELETE /identity/v3/users/80211f2d0968468183e5411671558120 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:47.031288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:47.035797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:47.064482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe2dfb0580c4cd3aff9345df536adb5', 'request_id': 'req-fa18dadc-c61e-4542-abf3-8b2285e86a98'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.159335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe2dfb0580c4cd3aff9345df536adb5', 'request_id': 'req-fa18dadc-c61e-4542-abf3-8b2285e86a98'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.169697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe2dfb0580c4cd3aff9345df536adb5', 'request_id': 'req-fa18dadc-c61e-4542-abf3-8b2285e86a98'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.183358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7e08-2618-49b7-90f8-5f4b42ab9d86 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:47.210046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] The token cache is being invalidate because project bfe2dfb0580c4cd3aff9345df536adb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:47.210753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.211787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.214175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1075/2145] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:46 2022] DELETE /identity/v3/projects/bfe2dfb0580c4cd3aff9345df536adb5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:47.214788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:47.217601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:47.224044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:47.312113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:47.312822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:47.314483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:47.314748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:47.316540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:47.318513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:47.347974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18dadc-c61e-4542-abf3-8b2285e86a98 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:47.354398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:47.355390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:47.355729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:47.356013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] PATH_INFO: `/v3/users/25bb0b615b5740eaab6b803b80b23757` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:47.357370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25bb0b615b5740eaab6b803b80b23757)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:47.360152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:47.374763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:47.468728 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1071/2146] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:47 2022] POST /identity/v3/users => generated 298 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:47.474179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:47.476167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:47.515450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35879e-9af7-4458-ba0c-45e6e5defcb9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:47.540062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12361fd5-31e6-4a88-8b86-6d121d0ba1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:47.543968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12361fd5-31e6-4a88-8b86-6d121d0ba1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:47.544366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12361fd5-31e6-4a88-8b86-6d121d0ba1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:47.544993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12361fd5-31e6-4a88-8b86-6d121d0ba1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:47.547290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12361fd5-31e6-4a88-8b86-6d121d0ba1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:47.549110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12361fd5-31e6-4a88-8b86-6d121d0ba1d9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:47.576052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1072/2147] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:47.584121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12361fd5-31e6-4a88-8b86-6d121d0ba1d9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:47.600626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12361fd5-31e6-4a88-8b86-6d121d0ba1d9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:47.607849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:47.609717 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25bb0b615b5740eaab6b803b80b23757'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.610253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:47.610486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25bb0b615b5740eaab6b803b80b23757'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.610836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:47.611258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] PATH_INFO: `/v3/projects/e175bb189a1a4f6c987638a2453c6db5/users/0a59d8fdc44649fcb93ec9b4edd9d8b3/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:47.639613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e175bb189a1a4f6c987638a2453c6db5, user_id=0a59d8fdc44649fcb93ec9b4edd9d8b3, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:47.644311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:47.687860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25bb0b615b5740eaab6b803b80b23757'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.708913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25bb0b615b5740eaab6b803b80b23757'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.718028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25bb0b615b5740eaab6b803b80b23757'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:47.724603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1076/2148] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:47 2022] DELETE /identity/v3/users/25bb0b615b5740eaab6b803b80b23757 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:47.733339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1073/2149] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:47 2022] PUT /identity/v3/projects/e175bb189a1a4f6c987638a2453c6db5/users/0a59d8fdc44649fcb93ec9b4edd9d8b3/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:47.737227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:47.739186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:47.774913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:47.776884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:47.915161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea3777-52f7-4366-82b0-1399bfcb841a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:47.918907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29933df4-5718-4bab-bdf1-9bd5d5624c53 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:47.924309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319719-87f4-472f-8291-b07444f91972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:47.924962 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319719-87f4-472f-8291-b07444f91972 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:47.925394 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319719-87f4-472f-8291-b07444f91972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:47.925669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32319719-87f4-472f-8291-b07444f91972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:47.926550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32319719-87f4-472f-8291-b07444f91972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:47.927560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:47.928224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32319719-87f4-472f-8291-b07444f91972 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:47.928504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:47.929057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:47.929336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] PATH_INFO: `/v3/projects/fedf417e5b22450eb4f4729065f64f90` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:47.931135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedf417e5b22450eb4f4729065f64f90)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:47.933154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:47.960170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1077/2150] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:47.961447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319719-87f4-472f-8291-b07444f91972 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:48.010316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32319719-87f4-472f-8291-b07444f91972 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:48.017518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181675e-764f-43fe-b48b-a1a6943c6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:48.019369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181675e-764f-43fe-b48b-a1a6943c6205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.020422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181675e-764f-43fe-b48b-a1a6943c6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.020959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181675e-764f-43fe-b48b-a1a6943c6205 admin admin] PATH_INFO: `/v3/projects/e175bb189a1a4f6c987638a2453c6db5/users/0a59d8fdc44649fcb93ec9b4edd9d8b3/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.023718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181675e-764f-43fe-b48b-a1a6943c6205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e175bb189a1a4f6c987638a2453c6db5, user_id=0a59d8fdc44649fcb93ec9b4edd9d8b3, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:48.031789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181675e-764f-43fe-b48b-a1a6943c6205 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:48.063279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1078/2151] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:47 2022] PUT /identity/v3/projects/e175bb189a1a4f6c987638a2453c6db5/users/0a59d8fdc44649fcb93ec9b4edd9d8b3/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:48.064486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f362817-b124-44a2-a1de-a29b2cb33f02 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.064913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f362817-b124-44a2-a1de-a29b2cb33f02 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.065283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f362817-b124-44a2-a1de-a29b2cb33f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.128284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3f362817-b124-44a2-a1de-a29b2cb33f02 None None] MFA Rules not processed for user `0a59d8fdc44649fcb93ec9b4edd9d8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:48.129704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3f362817-b124-44a2-a1de-a29b2cb33f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:48.147638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedf417e5b22450eb4f4729065f64f90', 'request_id': 'req-68765a47-454f-41ce-bc2c-b7c52cfc73aa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:48.243448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedf417e5b22450eb4f4729065f64f90', 'request_id': 'req-68765a47-454f-41ce-bc2c-b7c52cfc73aa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:48.253330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedf417e5b22450eb4f4729065f64f90', 'request_id': 'req-68765a47-454f-41ce-bc2c-b7c52cfc73aa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:48.296045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] The token cache is being invalidate because project fedf417e5b22450eb4f4729065f64f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:48.296270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:48.300754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68765a47-454f-41ce-bc2c-b7c52cfc73aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:48.302638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1074/2152] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:47 2022] DELETE /identity/v3/projects/fedf417e5b22450eb4f4729065f64f90 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:48.309076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfcd57-b7ba-41d2-aa44-efabcdf42223 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.309360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfcd57-b7ba-41d2-aa44-efabcdf42223 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.309637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfcd57-b7ba-41d2-aa44-efabcdf42223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.326606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1079/2153] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:48.357815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f362817-b124-44a2-a1de-a29b2cb33f02 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:48.361547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3f362817-b124-44a2-a1de-a29b2cb33f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:48.394241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-52dfcd57-b7ba-41d2-aa44-efabcdf42223 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:48.401055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-52dfcd57-b7ba-41d2-aa44-efabcdf42223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:48.433369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:48.473186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f362817-b124-44a2-a1de-a29b2cb33f02 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:48.478508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:48.479791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.480077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.480352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.482991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:48.503183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:48.504758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:48.510678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1075/2154] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:48.521216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e144d-f129-4e89-8f69-90f679bf1cb2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.521507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e144d-f129-4e89-8f69-90f679bf1cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.522640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e144d-f129-4e89-8f69-90f679bf1cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.534955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1080/2155] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:48.570064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:48.571795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-424e144d-f129-4e89-8f69-90f679bf1cb2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:48.573577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-424e144d-f129-4e89-8f69-90f679bf1cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:48.593213 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1076/2156] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:48.593942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:48.615346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e026b-3606-4318-b28b-b3981bd49422 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:48.624968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:48.626210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.626833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.629208 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.630051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:48.630434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:48.632586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:48.689801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e144d-f129-4e89-8f69-90f679bf1cb2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:48.697701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1081/2157] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:48.700744 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:48.704738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e144d-f129-4e89-8f69-90f679bf1cb2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:48.707456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:48.720044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16ada-acc1-45ec-b3b6-9330216f92cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:48.721642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16ada-acc1-45ec-b3b6-9330216f92cf admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.722096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16ada-acc1-45ec-b3b6-9330216f92cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.722471 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf16ada-acc1-45ec-b3b6-9330216f92cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.723990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf16ada-acc1-45ec-b3b6-9330216f92cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:48.727006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf16ada-acc1-45ec-b3b6-9330216f92cf admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:48.745421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd7303-b4b3-4cc8-9d38-fb5ea75f35b1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:48.757772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:48.758907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.758907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.759103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.764721 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:48.845311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1077/2158] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:48 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:48.847523 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16ada-acc1-45ec-b3b6-9330216f92cf admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:48.891886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:48.893992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:48.907512 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1082/2159] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:48.932896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:48.969797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf16ada-acc1-45ec-b3b6-9330216f92cf admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:48.982770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852d811-3492-4029-892d-873b56735039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:48.983667 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d811-3492-4029-892d-873b56735039 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:48.984111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d811-3492-4029-892d-873b56735039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:48.984692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852d811-3492-4029-892d-873b56735039 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:48.985583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852d811-3492-4029-892d-873b56735039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:48.989119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852d811-3492-4029-892d-873b56735039 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:49.091640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1078/2160] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:48 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:49.095710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:49.118260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaddb3b-2515-48ad-a53d-5ddfb26a63db service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:49.128646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4373449-e325-4321-81ed-c540913bd39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:49.129341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4373449-e325-4321-81ed-c540913bd39b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.129616 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4373449-e325-4321-81ed-c540913bd39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.129883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4373449-e325-4321-81ed-c540913bd39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.130650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4373449-e325-4321-81ed-c540913bd39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:49.133256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4373449-e325-4321-81ed-c540913bd39b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:49.153893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852d811-3492-4029-892d-873b56735039 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:49.157637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1083/2161] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:49.159440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0852d811-3492-4029-892d-873b56735039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:49.159567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4373449-e325-4321-81ed-c540913bd39b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:49.183680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4373449-e325-4321-81ed-c540913bd39b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:49.185611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852d811-3492-4029-892d-873b56735039 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:49.193173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:49.194096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.194382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.194659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] PATH_INFO: `/v3/projects/4f64b986f7834789bd26e7ec16cb7fe1` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.219781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f64b986f7834789bd26e7ec16cb7fe1)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:49.223803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6baa1-05cd-4558-930b-95819df5394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:49.226878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6baa1-05cd-4558-930b-95819df5394b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.226878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6baa1-05cd-4558-930b-95819df5394b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.226878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6baa1-05cd-4558-930b-95819df5394b admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.227167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:49.227261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6baa1-05cd-4558-930b-95819df5394b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:49.229100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6baa1-05cd-4558-930b-95819df5394b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:49.267063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1084/2162] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:49.269730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6baa1-05cd-4558-930b-95819df5394b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:49.298238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6baa1-05cd-4558-930b-95819df5394b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:49.311393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d3c7-adb9-4e48-8612-54095a5b2090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:49.312605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d3c7-adb9-4e48-8612-54095a5b2090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.312940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d3c7-adb9-4e48-8612-54095a5b2090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.313224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d3c7-adb9-4e48-8612-54095a5b2090 admin admin] PATH_INFO: `/v3/projects/ce852fa5f7aa4638b3825aece05994ca/users/85fcf53c67cb4b27b6b1c2255bc7dbbf/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.332550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d3c7-adb9-4e48-8612-54095a5b2090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce852fa5f7aa4638b3825aece05994ca, user_id=85fcf53c67cb4b27b6b1c2255bc7dbbf, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:49.341390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d3c7-adb9-4e48-8612-54095a5b2090 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:49.465499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1085/2163] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:49 2022] PUT /identity/v3/projects/ce852fa5f7aa4638b3825aece05994ca/users/85fcf53c67cb4b27b6b1c2255bc7dbbf/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:49.478834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c18bcc-73ff-4da8-8a26-0e3ee7d8372e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.480880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c18bcc-73ff-4da8-8a26-0e3ee7d8372e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.481305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c18bcc-73ff-4da8-8a26-0e3ee7d8372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.523786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f64b986f7834789bd26e7ec16cb7fe1', 'request_id': 'req-857d489f-dd2d-4280-b70a-7f4f82813be3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:49.553001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a3c18bcc-73ff-4da8-8a26-0e3ee7d8372e None None] MFA Rules not processed for user `85fcf53c67cb4b27b6b1c2255bc7dbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:49.555158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a3c18bcc-73ff-4da8-8a26-0e3ee7d8372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:49.610470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f64b986f7834789bd26e7ec16cb7fe1', 'request_id': 'req-857d489f-dd2d-4280-b70a-7f4f82813be3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:49.617733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f64b986f7834789bd26e7ec16cb7fe1', 'request_id': 'req-857d489f-dd2d-4280-b70a-7f4f82813be3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:49.636606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] The token cache is being invalidate because project 4f64b986f7834789bd26e7ec16cb7fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:49.636895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:49.637604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-857d489f-dd2d-4280-b70a-7f4f82813be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:49.639526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1079/2164] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:49 2022] DELETE /identity/v3/projects/4f64b986f7834789bd26e7ec16cb7fe1 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:49.648790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1086/2165] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:49.657368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c18bcc-73ff-4da8-8a26-0e3ee7d8372e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:49.659027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f225-783d-4973-b42a-b2cebf29b314 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.659958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f225-783d-4973-b42a-b2cebf29b314 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.660189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843f225-783d-4973-b42a-b2cebf29b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.686765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3843f225-783d-4973-b42a-b2cebf29b314 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:49.689079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3843f225-783d-4973-b42a-b2cebf29b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:49.822142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1080/2166] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:49.822438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c18bcc-73ff-4da8-8a26-0e3ee7d8372e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:49.824135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a036-d60e-4b16-b44e-7d2e70b815f8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.824515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a036-d60e-4b16-b44e-7d2e70b815f8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.825007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a036-d60e-4b16-b44e-7d2e70b815f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.831625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed1c6-ed42-473d-bfd6-d9f21ed9d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:49.832245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:49.833146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed1c6-ed42-473d-bfd6-d9f21ed9d4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.833624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed1c6-ed42-473d-bfd6-d9f21ed9d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.834121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed1c6-ed42-473d-bfd6-d9f21ed9d4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.835118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ed1c6-ed42-473d-bfd6-d9f21ed9d4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:49.837797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ed1c6-ed42-473d-bfd6-d9f21ed9d4b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:49.858215 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c969a036-d60e-4b16-b44e-7d2e70b815f8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:49.858689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c969a036-d60e-4b16-b44e-7d2e70b815f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:49.874174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1081/2167] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:49.877152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969a036-d60e-4b16-b44e-7d2e70b815f8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:49.888545 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969a036-d60e-4b16-b44e-7d2e70b815f8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:49.904304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a754a-5e4b-4be4-9ec1-1be6fafdfb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:49.904912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a754a-5e4b-4be4-9ec1-1be6fafdfb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.905466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a754a-5e4b-4be4-9ec1-1be6fafdfb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.905962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a754a-5e4b-4be4-9ec1-1be6fafdfb4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.907282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a754a-5e4b-4be4-9ec1-1be6fafdfb4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:49.907810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a754a-5e4b-4be4-9ec1-1be6fafdfb4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:49.910197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a754a-5e4b-4be4-9ec1-1be6fafdfb4d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:49.931925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1082/2168] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:43:49.941603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9922823-d6fa-4018-8bb3-4df8c16588c2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:49.941946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9922823-d6fa-4018-8bb3-4df8c16588c2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:49.942380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9922823-d6fa-4018-8bb3-4df8c16588c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:49.959908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1087/2169] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:49 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:49.960878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed1c6-ed42-473d-bfd6-d9f21ed9d4b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:49.976346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9922823-d6fa-4018-8bb3-4df8c16588c2 None None] MFA Rules not processed for user `2ffacb9e00b8448eb56a233a5d564d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:49.980565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9922823-d6fa-4018-8bb3-4df8c16588c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:50.061978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed1c6-ed42-473d-bfd6-d9f21ed9d4b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.067895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.069130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.069130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.069130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.069871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.072327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.081227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1083/2170] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:50.082230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9922823-d6fa-4018-8bb3-4df8c16588c2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.083636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9922823-d6fa-4018-8bb3-4df8c16588c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:50.100462 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9922823-d6fa-4018-8bb3-4df8c16588c2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.105143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac9890-56db-4e2d-be3d-cc0aa79aad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.105889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac9890-56db-4e2d-be3d-cc0aa79aad7e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.106262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac9890-56db-4e2d-be3d-cc0aa79aad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.106597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac9890-56db-4e2d-be3d-cc0aa79aad7e admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.107347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac9890-56db-4e2d-be3d-cc0aa79aad7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.109351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac9890-56db-4e2d-be3d-cc0aa79aad7e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.165760 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1088/2171] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:49 2022] POST /identity/v3/projects => generated 385 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:50.166631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.168163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:50.230852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1084/2172] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:50 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:50.231854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac9890-56db-4e2d-be3d-cc0aa79aad7e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.242212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac9890-56db-4e2d-be3d-cc0aa79aad7e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.297841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b531a-3b13-48f5-8081-6680bf8848f0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.306511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:50.318490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2a76d-d306-42dc-bc0b-d0dece2a2033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.318490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a76d-d306-42dc-bc0b-d0dece2a2033 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.318490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a76d-d306-42dc-bc0b-d0dece2a2033 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.318490 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2a76d-d306-42dc-bc0b-d0dece2a2033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.321764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b5c1-67cf-4f2d-8327-737355107547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.322636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b5c1-67cf-4f2d-8327-737355107547 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.322986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b5c1-67cf-4f2d-8327-737355107547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.323339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b5c1-67cf-4f2d-8327-737355107547 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.324098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b5c1-67cf-4f2d-8327-737355107547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.326418 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b5c1-67cf-4f2d-8327-737355107547 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.381550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2a76d-d306-42dc-bc0b-d0dece2a2033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.383231 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2a76d-d306-42dc-bc0b-d0dece2a2033 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.393001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1089/2173] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:50.393790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2a76d-d306-42dc-bc0b-d0dece2a2033 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.396793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1085/2174] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:50 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:50.400710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b5c1-67cf-4f2d-8327-737355107547 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.405541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2a76d-d306-42dc-bc0b-d0dece2a2033 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.409798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b5c1-67cf-4f2d-8327-737355107547 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.412193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab580b5-8fb4-4837-9d7a-ea27c847fbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.412899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab580b5-8fb4-4837-9d7a-ea27c847fbea admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.413144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab580b5-8fb4-4837-9d7a-ea27c847fbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.413403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab580b5-8fb4-4837-9d7a-ea27c847fbea admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.414272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab580b5-8fb4-4837-9d7a-ea27c847fbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.416099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab580b5-8fb4-4837-9d7a-ea27c847fbea admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.416244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b46d-aaec-4670-97b2-daef420ab973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.417183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b46d-aaec-4670-97b2-daef420ab973 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.417571 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b46d-aaec-4670-97b2-daef420ab973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.417938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b46d-aaec-4670-97b2-daef420ab973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.418796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b46d-aaec-4670-97b2-daef420ab973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.420465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b46d-aaec-4670-97b2-daef420ab973 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.433181 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1090/2175] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:50.434307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1086/2176] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:50.434447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab580b5-8fb4-4837-9d7a-ea27c847fbea admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.437978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b46d-aaec-4670-97b2-daef420ab973 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.449528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab580b5-8fb4-4837-9d7a-ea27c847fbea admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.449716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b46d-aaec-4670-97b2-daef420ab973 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.454900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ccc21-81a3-49bd-acd0-96695f5c10f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.455459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415821a-965d-4763-8d88-068bc882c4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.456561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ccc21-81a3-49bd-acd0-96695f5c10f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.456895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ccc21-81a3-49bd-acd0-96695f5c10f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.457050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415821a-965d-4763-8d88-068bc882c4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.457199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ccc21-81a3-49bd-acd0-96695f5c10f6 admin admin] PATH_INFO: `/v3/projects/7302a6aafc70450ca29688bae72b3760/users/63ac0ca4506b4cfc8b8f08b03d5bc63c/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.457308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415821a-965d-4763-8d88-068bc882c4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.458126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415821a-965d-4763-8d88-068bc882c4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.459070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415821a-965d-4763-8d88-068bc882c4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.463207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415821a-965d-4763-8d88-068bc882c4f3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.479111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1087/2177] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:50.483028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415821a-965d-4763-8d88-068bc882c4f3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.484428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ccc21-81a3-49bd-acd0-96695f5c10f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7302a6aafc70450ca29688bae72b3760, user_id=63ac0ca4506b4cfc8b8f08b03d5bc63c, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.487745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ccc21-81a3-49bd-acd0-96695f5c10f6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.497664 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415821a-965d-4763-8d88-068bc882c4f3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.503598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1147b-202e-41e4-99f0-0def04ba1dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.504483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1147b-202e-41e4-99f0-0def04ba1dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.504764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1147b-202e-41e4-99f0-0def04ba1dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.505037 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1147b-202e-41e4-99f0-0def04ba1dad admin admin] PATH_INFO: `/v3/projects/662b4e2537cf4056a73d0dc80dc7701e/users/e0375e91243e4ccf8455d2f314edaa80/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.521746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1147b-202e-41e4-99f0-0def04ba1dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=662b4e2537cf4056a73d0dc80dc7701e, user_id=e0375e91243e4ccf8455d2f314edaa80, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.524605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1147b-202e-41e4-99f0-0def04ba1dad admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.587446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1091/2178] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:50 2022] PUT /identity/v3/projects/7302a6aafc70450ca29688bae72b3760/users/63ac0ca4506b4cfc8b8f08b03d5bc63c/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:50.591304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ccc21-81a3-49bd-acd0-96695f5c10f6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.626546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1088/2179] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:50 2022] PUT /identity/v3/projects/662b4e2537cf4056a73d0dc80dc7701e/users/e0375e91243e4ccf8455d2f314edaa80/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:50.630987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6defa-3883-4205-8f83-ccbabf40b573 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.631420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6defa-3883-4205-8f83-ccbabf40b573 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.631822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6defa-3883-4205-8f83-ccbabf40b573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.664286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-13e6defa-3883-4205-8f83-ccbabf40b573 None None] MFA Rules not processed for user `e0375e91243e4ccf8455d2f314edaa80`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:50.665670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-13e6defa-3883-4205-8f83-ccbabf40b573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:50.673773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ccc21-81a3-49bd-acd0-96695f5c10f6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.766596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1089/2180] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:50.776372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6defa-3883-4205-8f83-ccbabf40b573 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.779115 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-13e6defa-3883-4205-8f83-ccbabf40b573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:50.791369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebface27-5b1b-4e0e-9e65-4eb42c9ccae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.792232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebface27-5b1b-4e0e-9e65-4eb42c9ccae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.792633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebface27-5b1b-4e0e-9e65-4eb42c9ccae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.793043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebface27-5b1b-4e0e-9e65-4eb42c9ccae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.793791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebface27-5b1b-4e0e-9e65-4eb42c9ccae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.795968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebface27-5b1b-4e0e-9e65-4eb42c9ccae8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.823467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1092/2181] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:50.827417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebface27-5b1b-4e0e-9e65-4eb42c9ccae8 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:50.845724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebface27-5b1b-4e0e-9e65-4eb42c9ccae8 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.856537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6defa-3883-4205-8f83-ccbabf40b573 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:50.857052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1033fbf-14aa-48d3-8f76-a0a0191e9d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.859432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033fbf-14aa-48d3-8f76-a0a0191e9d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.859718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033fbf-14aa-48d3-8f76-a0a0191e9d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.859993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1033fbf-14aa-48d3-8f76-a0a0191e9d02 admin admin] PATH_INFO: `/v3/projects/7302a6aafc70450ca29688bae72b3760/users/63ac0ca4506b4cfc8b8f08b03d5bc63c/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.862840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1033fbf-14aa-48d3-8f76-a0a0191e9d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7302a6aafc70450ca29688bae72b3760, user_id=63ac0ca4506b4cfc8b8f08b03d5bc63c, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.866689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1033fbf-14aa-48d3-8f76-a0a0191e9d02 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.869447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:50.870810 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.871363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.872579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.882061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1093/2182] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:50 2022] PUT /identity/v3/projects/7302a6aafc70450ca29688bae72b3760/users/63ac0ca4506b4cfc8b8f08b03d5bc63c/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:50.885159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:50.887043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:50.893055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdbfbd-8763-4198-b4e6-a204a235b24c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:50.893417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdbfbd-8763-4198-b4e6-a204a235b24c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:50.893834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efdbfbd-8763-4198-b4e6-a204a235b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:50.902907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1090/2183] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:43:50.952349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9efdbfbd-8763-4198-b4e6-a204a235b24c None None] MFA Rules not processed for user `63ac0ca4506b4cfc8b8f08b03d5bc63c`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:50.954320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9efdbfbd-8763-4198-b4e6-a204a235b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:51.080919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1094/2184] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:51.093660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:51.098590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:51.112101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018b838-4f70-442f-9d30-9a970f50bf53 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:51.198867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3990799-04f2-481f-a274-cce078c7f0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:51.199530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990799-04f2-481f-a274-cce078c7f0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:51.199816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990799-04f2-481f-a274-cce078c7f0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:51.207784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3990799-04f2-481f-a274-cce078c7f0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:51.210930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3990799-04f2-481f-a274-cce078c7f0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:51.212427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3990799-04f2-481f-a274-cce078c7f0e1 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:51.223284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1091/2185] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:51.294987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdbfbd-8763-4198-b4e6-a204a235b24c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:51.365482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efdbfbd-8763-4198-b4e6-a204a235b24c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:51.370157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:51.371062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:51.371383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:51.371606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] PATH_INFO: `/v3/users/85fcf53c67cb4b27b6b1c2255bc7dbbf` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:51.372815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85fcf53c67cb4b27b6b1c2255bc7dbbf)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:51.374901 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:51.462391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:51.635918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85fcf53c67cb4b27b6b1c2255bc7dbbf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:51.637219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85fcf53c67cb4b27b6b1c2255bc7dbbf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:51.711471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85fcf53c67cb4b27b6b1c2255bc7dbbf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:51.728752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85fcf53c67cb4b27b6b1c2255bc7dbbf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:51.737315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85fcf53c67cb4b27b6b1c2255bc7dbbf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:51.744812 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1095/2186] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:51 2022] DELETE /identity/v3/users/85fcf53c67cb4b27b6b1c2255bc7dbbf => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:51.750246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37206268-0555-4550-bdbe-2230a80dc29c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:51.750711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37206268-0555-4550-bdbe-2230a80dc29c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:51.750946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37206268-0555-4550-bdbe-2230a80dc29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:51.776446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-37206268-0555-4550-bdbe-2230a80dc29c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:51.777692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-37206268-0555-4550-bdbe-2230a80dc29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:51.861054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1092/2187] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:51.873525 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:51.876814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:51.971859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:52.012293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518518-b9e2-4016-a038-41663082b5f2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:52.016275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b50a9-b658-4d8e-a0a3-ad169340ae3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:52.016933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b50a9-b658-4d8e-a0a3-ad169340ae3f service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:52.018345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b50a9-b658-4d8e-a0a3-ad169340ae3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:52.019059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b50a9-b658-4d8e-a0a3-ad169340ae3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:52.042802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b50a9-b658-4d8e-a0a3-ad169340ae3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:52.042802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b50a9-b658-4d8e-a0a3-ad169340ae3f service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:52.069523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1096/2188] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:52.812474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37206268-0555-4550-bdbe-2230a80dc29c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:52.814512 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-37206268-0555-4550-bdbe-2230a80dc29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:52.830449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37206268-0555-4550-bdbe-2230a80dc29c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:52.841820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:52.842888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:52.843172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:52.843440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] PATH_INFO: `/v3/projects/ce852fa5f7aa4638b3825aece05994ca` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:52.847433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce852fa5f7aa4638b3825aece05994ca)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:52.849363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:53.005440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce852fa5f7aa4638b3825aece05994ca', 'request_id': 'req-4cd4e234-022a-4509-b67b-488253caaf8c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.060107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:53.099952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce852fa5f7aa4638b3825aece05994ca', 'request_id': 'req-4cd4e234-022a-4509-b67b-488253caaf8c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.108003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce852fa5f7aa4638b3825aece05994ca', 'request_id': 'req-4cd4e234-022a-4509-b67b-488253caaf8c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.122731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] The token cache is being invalidate because project ce852fa5f7aa4638b3825aece05994ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:53.123090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.123829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4cd4e234-022a-4509-b67b-488253caaf8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.125541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1093/2189] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:52 2022] DELETE /identity/v3/projects/ce852fa5f7aa4638b3825aece05994ca => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:53.129812 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b50a9-b658-4d8e-a0a3-ad169340ae3f service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:53.140873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b50a9-b658-4d8e-a0a3-ad169340ae3f service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:53.218947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:53.219461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:53.219737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:53.220104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] PATH_INFO: `/v3/users/63ac0ca4506b4cfc8b8f08b03d5bc63c` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:53.221570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63ac0ca4506b4cfc8b8f08b03d5bc63c)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:53.224106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:53.418841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:53.451498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63ac0ca4506b4cfc8b8f08b03d5bc63c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.452531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63ac0ca4506b4cfc8b8f08b03d5bc63c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.535895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63ac0ca4506b4cfc8b8f08b03d5bc63c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.552665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63ac0ca4506b4cfc8b8f08b03d5bc63c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.561001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63ac0ca4506b4cfc8b8f08b03d5bc63c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:53.594249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1097/2190] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:53 2022] DELETE /identity/v3/users/63ac0ca4506b4cfc8b8f08b03d5bc63c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:53.651362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9c71-7447-4882-91e4-ae73356b2854 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:53.651657 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9c71-7447-4882-91e4-ae73356b2854 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:53.651935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9c71-7447-4882-91e4-ae73356b2854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:53.670599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fd4e9c71-7447-4882-91e4-ae73356b2854 None None] MFA Rules not processed for user `2ffacb9e00b8448eb56a233a5d564d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:53.671796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fd4e9c71-7447-4882-91e4-ae73356b2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:53.769421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1094/2191] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:54.346746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:54.348489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:54.432585 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0a79a-9b2e-433f-963c-1ce0ec8c9a51 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:54.437627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:54.438730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:54.439138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:54.440521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] PATH_INFO: `/v3/projects/7302a6aafc70450ca29688bae72b3760` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:54.441700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7302a6aafc70450ca29688bae72b3760)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:54.443905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:54.473898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e9c71-7447-4882-91e4-ae73356b2854 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:54.476103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fd4e9c71-7447-4882-91e4-ae73356b2854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:54.490273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e9c71-7447-4882-91e4-ae73356b2854 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:54.494712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:54.495984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:54.496202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:54.496475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] PATH_INFO: `/v3/users/00b88924d4de4ccea29e45716a128469` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:54.497658 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b88924d4de4ccea29e45716a128469)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:54.499761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:54.606476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7302a6aafc70450ca29688bae72b3760', 'request_id': 'req-29a2a79f-d91c-40c0-8410-7d492c7c15d5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.666422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:54.717474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7302a6aafc70450ca29688bae72b3760', 'request_id': 'req-29a2a79f-d91c-40c0-8410-7d492c7c15d5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.725022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7302a6aafc70450ca29688bae72b3760', 'request_id': 'req-29a2a79f-d91c-40c0-8410-7d492c7c15d5'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.731492 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:54.736368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] The token cache is being invalidate because project 7302a6aafc70450ca29688bae72b3760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:54.736775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.737393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-29a2a79f-d91c-40c0-8410-7d492c7c15d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.739253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1098/2192] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:54 2022] DELETE /identity/v3/projects/7302a6aafc70450ca29688bae72b3760 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:54.743902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61513ea5-ff49-4070-99fe-ae3a850f7fef None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:54.744391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61513ea5-ff49-4070-99fe-ae3a850f7fef None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:54.744677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61513ea5-ff49-4070-99fe-ae3a850f7fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:54.744895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b88924d4de4ccea29e45716a128469'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.764295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-61513ea5-ff49-4070-99fe-ae3a850f7fef None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:54.765425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-61513ea5-ff49-4070-99fe-ae3a850f7fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:54.833792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1099/2193] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:54.842246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b88924d4de4ccea29e45716a128469'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.842597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc48349-3ae0-4be4-830c-da10fd9dba2f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:54.842987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc48349-3ae0-4be4-830c-da10fd9dba2f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:54.843362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc48349-3ae0-4be4-830c-da10fd9dba2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:54.855551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b88924d4de4ccea29e45716a128469'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.857127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b88924d4de4ccea29e45716a128469'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.870861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-abc48349-3ae0-4be4-830c-da10fd9dba2f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:54.873699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-abc48349-3ae0-4be4-830c-da10fd9dba2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:54.883472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-61793930-9562-4b0b-b34f-11efdc12a13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b88924d4de4ccea29e45716a128469'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:54.901463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1100/2194] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:54.902035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1095/2195] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:54 2022] DELETE /identity/v3/users/00b88924d4de4ccea29e45716a128469 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:54.902217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc48349-3ae0-4be4-830c-da10fd9dba2f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:54.906276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0449aa-f433-4e04-96aa-f2c739633485 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:54.906761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0449aa-f433-4e04-96aa-f2c739633485 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:54.909186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0449aa-f433-4e04-96aa-f2c739633485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:54.912712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc48349-3ae0-4be4-830c-da10fd9dba2f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:54.931178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9c0449aa-f433-4e04-96aa-f2c739633485 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:54.932623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9c0449aa-f433-4e04-96aa-f2c739633485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:54.997841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:54.998596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.000605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.000605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.000605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:55.000605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.001800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.010106 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1096/2196] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:55.020369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0449aa-f433-4e04-96aa-f2c739633485 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.020577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1101/2197] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:43:55.024385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9c0449aa-f433-4e04-96aa-f2c739633485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:55.025268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.036074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf54b34-6a22-4bd3-b577-7e07940e3f6e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:55.046405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10ad6-c0e7-43f8-af32-08609c63ec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:55.047026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10ad6-c0e7-43f8-af32-08609c63ec37 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.047962 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10ad6-c0e7-43f8-af32-08609c63ec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.048366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10ad6-c0e7-43f8-af32-08609c63ec37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.049065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa10ad6-c0e7-43f8-af32-08609c63ec37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.051618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa10ad6-c0e7-43f8-af32-08609c63ec37 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.104857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0449aa-f433-4e04-96aa-f2c739633485 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:55.108848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1631d-cb25-412e-8074-03511235e4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:55.109525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1631d-cb25-412e-8074-03511235e4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.109807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1631d-cb25-412e-8074-03511235e4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.110127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1631d-cb25-412e-8074-03511235e4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.119817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1631d-cb25-412e-8074-03511235e4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.121272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1631d-cb25-412e-8074-03511235e4e5 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.131582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1097/2198] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:55.216416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1102/2199] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:55 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:55.220418 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1631d-cb25-412e-8074-03511235e4e5 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.231086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1631d-cb25-412e-8074-03511235e4e5 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:55.287606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:55.288205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.288486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.288759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.289440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.291369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.379755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1098/2200] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:55 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:55.381179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10ad6-c0e7-43f8-af32-08609c63ec37 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.392683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10ad6-c0e7-43f8-af32-08609c63ec37 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:55.398361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5677dde-e5ac-43f8-be2e-37e2da378040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:55.399101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677dde-e5ac-43f8-be2e-37e2da378040 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.399451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677dde-e5ac-43f8-be2e-37e2da378040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.399797 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677dde-e5ac-43f8-be2e-37e2da378040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.400615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5677dde-e5ac-43f8-be2e-37e2da378040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.402348 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5677dde-e5ac-43f8-be2e-37e2da378040 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.410589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.412945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:55.417035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1103/2201] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:55.418122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5677dde-e5ac-43f8-be2e-37e2da378040 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.426047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54d99d-4b6f-4747-9793-2b822fc266da admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:55.430064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5677dde-e5ac-43f8-be2e-37e2da378040 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:55.431837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:55.433128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.433562 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.433984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] PATH_INFO: `/v3/users/e0375e91243e4ccf8455d2f314edaa80` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.435026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ef4b1-e762-4219-8b6e-36aaecef1ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:55.435674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef4b1-e762-4219-8b6e-36aaecef1ace admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.435954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef4b1-e762-4219-8b6e-36aaecef1ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.436122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0375e91243e4ccf8455d2f314edaa80)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.436277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ef4b1-e762-4219-8b6e-36aaecef1ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.437004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ef4b1-e762-4219-8b6e-36aaecef1ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.438623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ef4b1-e762-4219-8b6e-36aaecef1ace admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.438780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.453522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1104/2202] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:55.458466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ef4b1-e762-4219-8b6e-36aaecef1ace admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.469305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ef4b1-e762-4219-8b6e-36aaecef1ace admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:55.475074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:55.476022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.476397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.476723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] PATH_INFO: `/v3/projects/45017bd5fdd94946a38ed47273f92102/users/b963606d8d3f424e8c7e8bc258fcb046/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.493253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45017bd5fdd94946a38ed47273f92102, user_id=b963606d8d3f424e8c7e8bc258fcb046, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.495924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.609642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1105/2203] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:55 2022] PUT /identity/v3/projects/45017bd5fdd94946a38ed47273f92102/users/b963606d8d3f424e8c7e8bc258fcb046/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:55.610495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.612824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:55.669165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0375e91243e4ccf8455d2f314edaa80'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.691781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95e83d-d1c7-46fe-8d63-c2dd1b67044f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:55.697791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:55.698717 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.698992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.699273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] PATH_INFO: `/v3/projects/55d78f08740d4920baa9cb3ed2588534` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.700465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d78f08740d4920baa9cb3ed2588534)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:55.702402 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:55.723815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0375e91243e4ccf8455d2f314edaa80'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.732520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0375e91243e4ccf8455d2f314edaa80'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.734155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0375e91243e4ccf8455d2f314edaa80'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.755021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ae5bdb45-47bd-41c8-ad15-660c506e955c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0375e91243e4ccf8455d2f314edaa80'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.763644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1099/2204] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:55 2022] DELETE /identity/v3/users/e0375e91243e4ccf8455d2f314edaa80 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:55.765137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95258301-3569-4bfe-adf4-864341ff505c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.768386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95258301-3569-4bfe-adf4-864341ff505c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.768386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95258301-3569-4bfe-adf4-864341ff505c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.795192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-95258301-3569-4bfe-adf4-864341ff505c None None] MFA Rules not processed for user `b963606d8d3f424e8c7e8bc258fcb046`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:55.799736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-95258301-3569-4bfe-adf4-864341ff505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:55.835248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d78f08740d4920baa9cb3ed2588534', 'request_id': 'req-2e786794-5d7b-4078-b24a-95ebe72299f0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.887407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1100/2205] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:55.895654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45428-3ef2-42d2-a434-595f37c1a035 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:55.895991 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45428-3ef2-42d2-a434-595f37c1a035 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:55.896270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45428-3ef2-42d2-a434-595f37c1a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:55.900396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d78f08740d4920baa9cb3ed2588534', 'request_id': 'req-2e786794-5d7b-4078-b24a-95ebe72299f0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.906620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d78f08740d4920baa9cb3ed2588534', 'request_id': 'req-2e786794-5d7b-4078-b24a-95ebe72299f0'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.916322 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cce45428-3ef2-42d2-a434-595f37c1a035 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:55.917526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cce45428-3ef2-42d2-a434-595f37c1a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:55.918261 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] The token cache is being invalidate because project 55d78f08740d4920baa9cb3ed2588534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:55.918549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.919338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:55.920917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1106/2206] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:55 2022] DELETE /identity/v3/projects/55d78f08740d4920baa9cb3ed2588534 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:55.921697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:55.924906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:56.005882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1101/2207] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:56.007660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce45428-3ef2-42d2-a434-595f37c1a035 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:56.019373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cce45428-3ef2-42d2-a434-595f37c1a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:56.034615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce45428-3ef2-42d2-a434-595f37c1a035 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.039615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e786794-5d7b-4078-b24a-95ebe72299f0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.040139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.041064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.041333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.041734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] PATH_INFO: `/v3/users/0a59d8fdc44649fcb93ec9b4edd9d8b3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.042953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a59d8fdc44649fcb93ec9b4edd9d8b3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.045028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:56.046127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.046983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.047440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.047809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.048589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.051775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:56.171025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1107/2208] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:55 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:56.175708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:56.177373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:56.200306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:56.262584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b3b4-425a-46cc-b0e6-eaaf76aaea22 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.266313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a72f8-61a6-4ec3-bfca-de28aea10c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.268388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a72f8-61a6-4ec3-bfca-de28aea10c83 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.268388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a72f8-61a6-4ec3-bfca-de28aea10c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.268388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a72f8-61a6-4ec3-bfca-de28aea10c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.294818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:56.331555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a72f8-61a6-4ec3-bfca-de28aea10c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.333434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a72f8-61a6-4ec3-bfca-de28aea10c83 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:56.349527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a59d8fdc44649fcb93ec9b4edd9d8b3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:56.357513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1108/2209] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:56.358409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a72f8-61a6-4ec3-bfca-de28aea10c83 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:56.371169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a72f8-61a6-4ec3-bfca-de28aea10c83 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.376517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd55cf-d150-45e3-bd4f-92ccabbfffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.379036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd55cf-d150-45e3-bd4f-92ccabbfffcf admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.379036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd55cf-d150-45e3-bd4f-92ccabbfffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.379341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd55cf-d150-45e3-bd4f-92ccabbfffcf admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.380010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd55cf-d150-45e3-bd4f-92ccabbfffcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.381936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd55cf-d150-45e3-bd4f-92ccabbfffcf admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:56.426199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a59d8fdc44649fcb93ec9b4edd9d8b3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:56.434151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a59d8fdc44649fcb93ec9b4edd9d8b3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:56.434946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a59d8fdc44649fcb93ec9b4edd9d8b3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:56.448315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a59d8fdc44649fcb93ec9b4edd9d8b3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:56.454553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1102/2210] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:43:56 2022] DELETE /identity/v3/users/0a59d8fdc44649fcb93ec9b4edd9d8b3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:56.490081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1109/2211] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:56 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:56.494212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:56.495741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:56.563603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f5626-b950-4061-8c02-7a25d3b735b1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.568549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3347-a29a-4cf1-b9f6-d9d546de800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.569233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3347-a29a-4cf1-b9f6-d9d546de800d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.569518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3347-a29a-4cf1-b9f6-d9d546de800d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.569803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3347-a29a-4cf1-b9f6-d9d546de800d admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.570572 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3347-a29a-4cf1-b9f6-d9d546de800d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.572256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3347-a29a-4cf1-b9f6-d9d546de800d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:56.583240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1103/2212] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:56.587297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd55cf-d150-45e3-bd4f-92ccabbfffcf admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:56.598942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd55cf-d150-45e3-bd4f-92ccabbfffcf admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.604100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa9246-4fd5-49dd-bf33-9f51c78551bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.604987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa9246-4fd5-49dd-bf33-9f51c78551bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.605268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa9246-4fd5-49dd-bf33-9f51c78551bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.605584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa9246-4fd5-49dd-bf33-9f51c78551bf admin admin] PATH_INFO: `/v3/projects/9cc47a85948946b4b6ae8a290c2834f8/users/897c88e6f74e4b4a8d63894b8c4aa1da/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.624366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa9246-4fd5-49dd-bf33-9f51c78551bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc47a85948946b4b6ae8a290c2834f8, user_id=897c88e6f74e4b4a8d63894b8c4aa1da, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.627426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa9246-4fd5-49dd-bf33-9f51c78551bf admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:56.732416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1110/2213] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:56 2022] PUT /identity/v3/projects/9cc47a85948946b4b6ae8a290c2834f8/users/897c88e6f74e4b4a8d63894b8c4aa1da/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:56.743539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3347-a29a-4cf1-b9f6-d9d546de800d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:56.754176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3347-a29a-4cf1-b9f6-d9d546de800d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.826965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.827709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.827997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.828273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.829022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.832236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:56.847576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1104/2214] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:56.848784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa9246-4fd5-49dd-bf33-9f51c78551bf admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:56.861150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa9246-4fd5-49dd-bf33-9f51c78551bf admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.874368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956cde5-2a59-4236-8130-07e2d8a4ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.875285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956cde5-2a59-4236-8130-07e2d8a4ebb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.875560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956cde5-2a59-4236-8130-07e2d8a4ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.875829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956cde5-2a59-4236-8130-07e2d8a4ebb8 admin admin] PATH_INFO: `/v3/projects/9cc47a85948946b4b6ae8a290c2834f8/users/897c88e6f74e4b4a8d63894b8c4aa1da/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.878178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956cde5-2a59-4236-8130-07e2d8a4ebb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc47a85948946b4b6ae8a290c2834f8, user_id=897c88e6f74e4b4a8d63894b8c4aa1da, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.882032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956cde5-2a59-4236-8130-07e2d8a4ebb8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:56.890690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:56.892559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:56.898068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1111/2215] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:56 2022] PUT /identity/v3/projects/9cc47a85948946b4b6ae8a290c2834f8/users/897c88e6f74e4b4a8d63894b8c4aa1da/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:56.907188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b35f1-ae1b-4069-9f46-d8973b0488e7 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.907829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b35f1-ae1b-4069-9f46-d8973b0488e7 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.908133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b35f1-ae1b-4069-9f46-d8973b0488e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.910830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a0e6a-4a8b-401b-848e-2fb8e6ea8f33 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:56.945837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ca3b35f1-ae1b-4069-9f46-d8973b0488e7 None None] MFA Rules not processed for user `897c88e6f74e4b4a8d63894b8c4aa1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:56.947170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ca3b35f1-ae1b-4069-9f46-d8973b0488e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:56.975900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:56.977034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:56.977245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:56.977519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] PATH_INFO: `/v3/projects/662b4e2537cf4056a73d0dc80dc7701e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:56.978770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=662b4e2537cf4056a73d0dc80dc7701e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:56.980682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.024734 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1112/2216] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:57.025715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b35f1-ae1b-4069-9f46-d8973b0488e7 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:57.026990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ca3b35f1-ae1b-4069-9f46-d8973b0488e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:57.041191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b35f1-ae1b-4069-9f46-d8973b0488e7 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:57.045775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:57.046661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.046933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.047195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] PATH_INFO: `/v3/projects/e175bb189a1a4f6c987638a2453c6db5` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.048354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e175bb189a1a4f6c987638a2453c6db5)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:57.050514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.085458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662b4e2537cf4056a73d0dc80dc7701e', 'request_id': 'req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.180499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662b4e2537cf4056a73d0dc80dc7701e', 'request_id': 'req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.185684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e175bb189a1a4f6c987638a2453c6db5', 'request_id': 'req-58f2a5eb-10d9-4705-b440-46891d2325a1'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.186905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662b4e2537cf4056a73d0dc80dc7701e', 'request_id': 'req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.199456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] The token cache is being invalidate because project 662b4e2537cf4056a73d0dc80dc7701e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:57.199740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.200375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.201939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1105/2217] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:56 2022] DELETE /identity/v3/projects/662b4e2537cf4056a73d0dc80dc7701e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:57.206056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:57.206056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:57.270526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20953a-31d0-4f16-bac8-9f3e1958bcdb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:57.294426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e175bb189a1a4f6c987638a2453c6db5', 'request_id': 'req-58f2a5eb-10d9-4705-b440-46891d2325a1'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.301291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e175bb189a1a4f6c987638a2453c6db5', 'request_id': 'req-58f2a5eb-10d9-4705-b440-46891d2325a1'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.315260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] The token cache is being invalidate because project e175bb189a1a4f6c987638a2453c6db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:43:57.315554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.318062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-58f2a5eb-10d9-4705-b440-46891d2325a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:43:57.320021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1113/2218] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:43:57 2022] DELETE /identity/v3/projects/e175bb189a1a4f6c987638a2453c6db5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:43:57.324880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399fd19-c110-4812-b33d-87b9f463eded None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.325232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399fd19-c110-4812-b33d-87b9f463eded None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.325591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399fd19-c110-4812-b33d-87b9f463eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.331564 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:57.332225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.332503 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.332800 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.334685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:57.346696 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5399fd19-c110-4812-b33d-87b9f463eded None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:57.348083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5399fd19-c110-4812-b33d-87b9f463eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:57.419702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1114/2219] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:43:57.424979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:57.426930 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb54a3-fc32-4cf8-89e5-392e9c294c01 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.427219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb54a3-fc32-4cf8-89e5-392e9c294c01 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.427496 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb54a3-fc32-4cf8-89e5-392e9c294c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.428075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.441351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1106/2220] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:43:57.449163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-74bb54a3-fc32-4cf8-89e5-392e9c294c01 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:57.450515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-74bb54a3-fc32-4cf8-89e5-392e9c294c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:57.462154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1115/2221] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:57.463898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:57.477318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e4a8-6929-418d-9c0e-7f040961714a service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:57.482579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:57.483249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.483711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.483991 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.484779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:43:57.485091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:57.487790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.505675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1107/2222] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:43:57.506803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb54a3-fc32-4cf8-89e5-392e9c294c01 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:57.516667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb54a3-fc32-4cf8-89e5-392e9c294c01 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:57.524678 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878b5b-a538-4fee-8c7c-1825818d32ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:57.525346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878b5b-a538-4fee-8c7c-1825818d32ba admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.525627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878b5b-a538-4fee-8c7c-1825818d32ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.525907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b878b5b-a538-4fee-8c7c-1825818d32ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.526675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b878b5b-a538-4fee-8c7c-1825818d32ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:57.528573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b878b5b-a538-4fee-8c7c-1825818d32ba admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.637378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1116/2223] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:57 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:57.641685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:57.653621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e806d-007f-46ae-80fa-bdb8c7813294 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:57.714836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68901-91bb-4b96-9fff-141aeef9f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:57.715415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68901-91bb-4b96-9fff-141aeef9f486 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.715695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68901-91bb-4b96-9fff-141aeef9f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.715967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b68901-91bb-4b96-9fff-141aeef9f486 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.716644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b68901-91bb-4b96-9fff-141aeef9f486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:57.718567 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b68901-91bb-4b96-9fff-141aeef9f486 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.797660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1108/2224] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:57 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:57.802402 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878b5b-a538-4fee-8c7c-1825818d32ba admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:57.813070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b878b5b-a538-4fee-8c7c-1825818d32ba admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:57.818473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c41ea5-1f2f-4ab9-9919-8de7dbb35755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:57.819145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c41ea5-1f2f-4ab9-9919-8de7dbb35755 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.819424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c41ea5-1f2f-4ab9-9919-8de7dbb35755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.819725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c41ea5-1f2f-4ab9-9919-8de7dbb35755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.820476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c41ea5-1f2f-4ab9-9919-8de7dbb35755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:57.822101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c41ea5-1f2f-4ab9-9919-8de7dbb35755 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.832505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1117/2225] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:57.836539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68901-91bb-4b96-9fff-141aeef9f486 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:57.846749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b68901-91bb-4b96-9fff-141aeef9f486 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:57.851545 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065e521-3442-4ad1-b268-ea3d0a5130f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:57.852191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e521-3442-4ad1-b268-ea3d0a5130f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.852500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e521-3442-4ad1-b268-ea3d0a5130f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.852784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e521-3442-4ad1-b268-ea3d0a5130f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.853615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e521-3442-4ad1-b268-ea3d0a5130f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:57.855288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e521-3442-4ad1-b268-ea3d0a5130f0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.872934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1109/2226] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:43:57.877987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c41ea5-1f2f-4ab9-9919-8de7dbb35755 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:57.879971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:57.889564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c41ea5-1f2f-4ab9-9919-8de7dbb35755 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:57.894584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:57.895579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.895863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.896139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] PATH_INFO: `/v3/projects/c0bd63e1295e4801885f2bc9c6212fb6/users/059633d521f247b785831d9d77a9e05e/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:57.911725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bd63e1295e4801885f2bc9c6212fb6, user_id=059633d521f247b785831d9d77a9e05e, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:57.914436 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:57.957891 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:57.993403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1118/2227] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:57 2022] PUT /identity/v3/projects/c0bd63e1295e4801885f2bc9c6212fb6/users/059633d521f247b785831d9d77a9e05e/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:43:57.999406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971cb6-2003-45ce-bf38-3ab8897c5617 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:57.999695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971cb6-2003-45ce-bf38-3ab8897c5617 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:57.999975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b971cb6-2003-45ce-bf38-3ab8897c5617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:58.022989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9b971cb6-2003-45ce-bf38-3ab8897c5617 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:58.024201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9b971cb6-2003-45ce-bf38-3ab8897c5617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:58.090082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1110/2228] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:58.100104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:58.102207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:58.158890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ef90-ab64-4c60-af8c-07b556aec733 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:58.162539 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d6237-24e1-4f93-a7bc-8de926c9ea8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:58.163158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6237-24e1-4f93-a7bc-8de926c9ea8e service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:58.163699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6237-24e1-4f93-a7bc-8de926c9ea8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:58.163980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6237-24e1-4f93-a7bc-8de926c9ea8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:58.179225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d6237-24e1-4f93-a7bc-8de926c9ea8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:58.181033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d6237-24e1-4f93-a7bc-8de926c9ea8e service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:58.197662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1119/2229] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:43:58.348178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:58.758026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:58.798087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:59.415007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:59.543366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da96d1-a1d6-4092-ba72-ec8dfd0f761b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:59.543912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da96d1-a1d6-4092-ba72-ec8dfd0f761b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:59.543912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da96d1-a1d6-4092-ba72-ec8dfd0f761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:59.574464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f5da96d1-a1d6-4092-ba72-ec8dfd0f761b None None] MFA Rules not processed for user `059633d521f247b785831d9d77a9e05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:43:59.575721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f5da96d1-a1d6-4092-ba72-ec8dfd0f761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:43:59.646362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1111/2230] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:43:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:43:59.650935 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d6237-24e1-4f93-a7bc-8de926c9ea8e service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:59.661113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d6237-24e1-4f93-a7bc-8de926c9ea8e service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:59.665712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d659-7afb-4d2a-bcc6-b893c2216ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:59.666462 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d659-7afb-4d2a-bcc6-b893c2216ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:59.666746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d659-7afb-4d2a-bcc6-b893c2216ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:59.667021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d659-7afb-4d2a-bcc6-b893c2216ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:59.667715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d659-7afb-4d2a-bcc6-b893c2216ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:59.669691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d659-7afb-4d2a-bcc6-b893c2216ba5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:59.789961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1120/2231] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:43:59 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:43:59.790233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da96d1-a1d6-4092-ba72-ec8dfd0f761b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:59.799686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da96d1-a1d6-4092-ba72-ec8dfd0f761b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:59.811528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:59.863013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e596b-9d08-49bc-bd36-36840480fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:59.863690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e596b-9d08-49bc-bd36-36840480fd6d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:59.863974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e596b-9d08-49bc-bd36-36840480fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:59.864251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e596b-9d08-49bc-bd36-36840480fd6d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:59.865012 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e596b-9d08-49bc-bd36-36840480fd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:59.867042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e596b-9d08-49bc-bd36-36840480fd6d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:59.959332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1112/2232] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:43:59 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:43:59.961949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d659-7afb-4d2a-bcc6-b893c2216ba5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:43:59.972551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d659-7afb-4d2a-bcc6-b893c2216ba5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:43:59.977438 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c27ee-b2f3-40b8-8bd1-093b164e7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:43:59.978170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c27ee-b2f3-40b8-8bd1-093b164e7c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:43:59.978698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c27ee-b2f3-40b8-8bd1-093b164e7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:43:59.979104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c27ee-b2f3-40b8-8bd1-093b164e7c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:43:59.979846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c27ee-b2f3-40b8-8bd1-093b164e7c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:43:59.981592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c27ee-b2f3-40b8-8bd1-093b164e7c95 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:43:59.993621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1121/2233] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:43:59.997701 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e596b-9d08-49bc-bd36-36840480fd6d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:00.009402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e596b-9d08-49bc-bd36-36840480fd6d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:00.014533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9506-8c0b-4cc3-aa1f-a0c287513f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:00.015445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9506-8c0b-4cc3-aa1f-a0c287513f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:00.015726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9506-8c0b-4cc3-aa1f-a0c287513f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:00.015998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e9506-8c0b-4cc3-aa1f-a0c287513f4f admin admin] PATH_INFO: `/v3/projects/b41cba4d014f4bc4a22af01404fb6d69/users/c1d9137ae0c74ccdae3a33254fe8534d/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:00.032435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e9506-8c0b-4cc3-aa1f-a0c287513f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41cba4d014f4bc4a22af01404fb6d69, user_id=c1d9137ae0c74ccdae3a33254fe8534d, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:00.035534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e9506-8c0b-4cc3-aa1f-a0c287513f4f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:00.138074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1113/2234] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:43:59 2022] PUT /identity/v3/projects/b41cba4d014f4bc4a22af01404fb6d69/users/c1d9137ae0c74ccdae3a33254fe8534d/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:00.141750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c27ee-b2f3-40b8-8bd1-093b164e7c95 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:00.153238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c27ee-b2f3-40b8-8bd1-093b164e7c95 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:00.243352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d43d77-9c87-4180-924b-f37dd6147f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:00.244573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43d77-9c87-4180-924b-f37dd6147f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:00.246040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43d77-9c87-4180-924b-f37dd6147f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:00.246040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d43d77-9c87-4180-924b-f37dd6147f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:00.246040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d43d77-9c87-4180-924b-f37dd6147f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:00.249782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d43d77-9c87-4180-924b-f37dd6147f80 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:00.261634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1122/2235] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:44:00.265946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9506-8c0b-4cc3-aa1f-a0c287513f4f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:00.281485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e9506-8c0b-4cc3-aa1f-a0c287513f4f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:00.284592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:00.285715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:00.286142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:00.286518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] PATH_INFO: `/v3/projects/b41cba4d014f4bc4a22af01404fb6d69/users/c1d9137ae0c74ccdae3a33254fe8534d/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:00.288720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41cba4d014f4bc4a22af01404fb6d69, user_id=c1d9137ae0c74ccdae3a33254fe8534d, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:00.294947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:00.306825 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1114/2236] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:00 2022] PUT /identity/v3/projects/b41cba4d014f4bc4a22af01404fb6d69/users/c1d9137ae0c74ccdae3a33254fe8534d/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:00.757677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:00.894986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:01.699476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:02.142127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae4fd-01f0-4255-8013-bd0e358102b1 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:02.143251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae4fd-01f0-4255-8013-bd0e358102b1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:02.143251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae4fd-01f0-4255-8013-bd0e358102b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:02.170574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-982ae4fd-01f0-4255-8013-bd0e358102b1 None None] MFA Rules not processed for user `c1d9137ae0c74ccdae3a33254fe8534d`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:02.171878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-982ae4fd-01f0-4255-8013-bd0e358102b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:02.245138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1123/2237] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:02.257134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:02.259155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:02.318598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0dda5-5d16-4e39-9794-a821c17fc862 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:02.322514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:02.323156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:02.323436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:02.323710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:02.382868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:02.384337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:02.391928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:02.393738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1115/2238] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:02.477263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:03.003021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:03.140274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:03.593600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:03.843469 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:04.072311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:04.214902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:04.449253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:04.797451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:04.923348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:05.197812 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ae4fd-01f0-4255-8013-bd0e358102b1 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:05.208859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ae4fd-01f0-4255-8013-bd0e358102b1 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:05.213166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdabcca-4a17-4acb-ab90-375958c60093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:05.213882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabcca-4a17-4acb-ab90-375958c60093 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:05.214255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabcca-4a17-4acb-ab90-375958c60093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:05.214620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabcca-4a17-4acb-ab90-375958c60093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:05.225398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdabcca-4a17-4acb-ab90-375958c60093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:05.230710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdabcca-4a17-4acb-ab90-375958c60093 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:05.238551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1124/2239] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:05.263852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:05.265327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:05.278296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce556ac-c0e6-49e7-b702-3ecbe70f9f92 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:05.282394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:05.283162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:05.283849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:05.284291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:05.286204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:05.379414 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:05.382573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:05.395681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1116/2240] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:09.727927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03add446-5bde-4039-810e-e1fba6f0b993 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:09.728418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03add446-5bde-4039-810e-e1fba6f0b993 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:09.728510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03add446-5bde-4039-810e-e1fba6f0b993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:09.789642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-03add446-5bde-4039-810e-e1fba6f0b993 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:09.790903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-03add446-5bde-4039-810e-e1fba6f0b993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:09.820454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:09.856738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1125/2241] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:44:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:09.901265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:09.902687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:09.993901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b2d73-f4e2-408c-80bf-3bce323fa88e service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:09.999009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4614-87f7-43eb-95fd-83b4a8e4ca2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:09.999690 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4614-87f7-43eb-95fd-83b4a8e4ca2d service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:09.999972 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4614-87f7-43eb-95fd-83b4a8e4ca2d service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:10.000250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff4614-87f7-43eb-95fd-83b4a8e4ca2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:10.009088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff4614-87f7-43eb-95fd-83b4a8e4ca2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:10.010686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff4614-87f7-43eb-95fd-83b4a8e4ca2d service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:10.018519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1117/2242] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:44:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 22:44:10.917685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62aeda-7ed2-4fb4-aa24-98e8a9be22b4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:10.918216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62aeda-7ed2-4fb4-aa24-98e8a9be22b4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:10.918321 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62aeda-7ed2-4fb4-aa24-98e8a9be22b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:10.936287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1b62aeda-7ed2-4fb4-aa24-98e8a9be22b4 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:10.937507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1b62aeda-7ed2-4fb4-aa24-98e8a9be22b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:10.945503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1126/2243] 10.222.0.70 () {58 vars in 967 bytes} [Wed May 18 22:44:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:10.961021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4614-87f7-43eb-95fd-83b4a8e4ca2d service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:10.971660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff4614-87f7-43eb-95fd-83b4a8e4ca2d service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:10.976852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1419a-09af-4055-a050-b24aa3cde6aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:10.977487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1419a-09af-4055-a050-b24aa3cde6aa service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:10.977767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1419a-09af-4055-a050-b24aa3cde6aa service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:10.978087 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1419a-09af-4055-a050-b24aa3cde6aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:10.986381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1419a-09af-4055-a050-b24aa3cde6aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:10.987938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1419a-09af-4055-a050-b24aa3cde6aa service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:10.996372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1118/2244] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:44:11.556417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6699b2-d5eb-40bc-a864-1d64210bc95f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:11.556703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6699b2-d5eb-40bc-a864-1d64210bc95f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:11.556975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6699b2-d5eb-40bc-a864-1d64210bc95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:11.575853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fa6699b2-d5eb-40bc-a864-1d64210bc95f None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:11.576074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fa6699b2-d5eb-40bc-a864-1d64210bc95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:11.583511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1127/2245] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:44:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:11.595767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1419a-09af-4055-a050-b24aa3cde6aa service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:11.607042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1419a-09af-4055-a050-b24aa3cde6aa service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:11.612157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935836-3557-4bb2-8a1c-76ba5e24b9fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:11.612805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935836-3557-4bb2-8a1c-76ba5e24b9fc service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:11.613084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935836-3557-4bb2-8a1c-76ba5e24b9fc service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:11.613351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27935836-3557-4bb2-8a1c-76ba5e24b9fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:11.622132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935836-3557-4bb2-8a1c-76ba5e24b9fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:11.623678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27935836-3557-4bb2-8a1c-76ba5e24b9fc service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:11.632061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1119/2246] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:44:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:44:12.233746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa06a2-a092-43df-84bc-02506facf20d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:12.234236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa06a2-a092-43df-84bc-02506facf20d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:12.234328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa06a2-a092-43df-84bc-02506facf20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:12.252296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a7aa06a2-a092-43df-84bc-02506facf20d None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:12.253527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a7aa06a2-a092-43df-84bc-02506facf20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:12.260719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1128/2247] 10.222.0.70 () {58 vars in 967 bytes} [Wed May 18 22:44:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:12.272878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935836-3557-4bb2-8a1c-76ba5e24b9fc service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:12.283465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27935836-3557-4bb2-8a1c-76ba5e24b9fc service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:12.289156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ae7bf-fdfa-41c2-b737-e10333641f44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:12.289785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae7bf-fdfa-41c2-b737-e10333641f44 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:12.290098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae7bf-fdfa-41c2-b737-e10333641f44 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:12.290376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae7bf-fdfa-41c2-b737-e10333641f44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:12.298405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ae7bf-fdfa-41c2-b737-e10333641f44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:12.299963 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ae7bf-fdfa-41c2-b737-e10333641f44 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:12.308468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1120/2248] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:44:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:44:14.911317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa06a2-a092-43df-84bc-02506facf20d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:14.916024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a7aa06a2-a092-43df-84bc-02506facf20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:14.979425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa06a2-a092-43df-84bc-02506facf20d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:14.983983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:14.985666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:14.985666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:14.985666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] PATH_INFO: `/v3/users/bd1e0f88dc7f4eb494dea5d9af86a5f9` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:14.987089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1e0f88dc7f4eb494dea5d9af86a5f9)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:14.989039 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:15.188152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1e0f88dc7f4eb494dea5d9af86a5f9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:15.188796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1e0f88dc7f4eb494dea5d9af86a5f9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:15.248222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1e0f88dc7f4eb494dea5d9af86a5f9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:15.261187 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1e0f88dc7f4eb494dea5d9af86a5f9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:15.268488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1e0f88dc7f4eb494dea5d9af86a5f9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:15.275207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1129/2249] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:14 2022] DELETE /identity/v3/users/bd1e0f88dc7f4eb494dea5d9af86a5f9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:15.279720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e14edc-ad4e-4851-bbe9-f28435b440a6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:15.280267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e14edc-ad4e-4851-bbe9-f28435b440a6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:15.280267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e14edc-ad4e-4851-bbe9-f28435b440a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:15.298332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-49e14edc-ad4e-4851-bbe9-f28435b440a6 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:15.302207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-49e14edc-ad4e-4851-bbe9-f28435b440a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:15.311995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:15.369497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1121/2250] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:44:15.380480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:15.382051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:15.433993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:15.462096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381fea-1e5e-4215-83e2-87c8c4189bec admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:15.466924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:15.467663 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:15.468047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:15.468392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:15.480139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:15.481816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:15.499321 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1130/2251] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:15.781640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e14edc-ad4e-4851-bbe9-f28435b440a6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:15.783303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-49e14edc-ad4e-4851-bbe9-f28435b440a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:15.799609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e14edc-ad4e-4851-bbe9-f28435b440a6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:15.806151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:15.807008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:15.807282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:15.807552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] PATH_INFO: `/v3/projects/722f661c6312401b855c408a84d87639` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:15.808895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=722f661c6312401b855c408a84d87639)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:15.810803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:15.929308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722f661c6312401b855c408a84d87639', 'request_id': 'req-fc557227-7e33-407d-b741-0e83be24f272'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:16.014307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722f661c6312401b855c408a84d87639', 'request_id': 'req-fc557227-7e33-407d-b741-0e83be24f272'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:16.020656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722f661c6312401b855c408a84d87639', 'request_id': 'req-fc557227-7e33-407d-b741-0e83be24f272'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:16.032202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] The token cache is being invalidate because project 722f661c6312401b855c408a84d87639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:16.032426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:16.033101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fc557227-7e33-407d-b741-0e83be24f272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:16.034716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1122/2252] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:15 2022] DELETE /identity/v3/projects/722f661c6312401b855c408a84d87639 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:16.766868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:16.768336 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:16.782440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa64ca-e947-41ae-a67d-7d75596dd89b service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:16.849821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:16.855103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:16.855476 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:16.855827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] PATH_INFO: `/v3/users/b963606d8d3f424e8c7e8bc258fcb046` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:16.857602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b963606d8d3f424e8c7e8bc258fcb046)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:16.859796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:17.103962 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b963606d8d3f424e8c7e8bc258fcb046'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:17.104553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b963606d8d3f424e8c7e8bc258fcb046'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:17.174152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b963606d8d3f424e8c7e8bc258fcb046'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:17.188879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b963606d8d3f424e8c7e8bc258fcb046'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:17.196904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b963606d8d3f424e8c7e8bc258fcb046'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:17.203190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1131/2253] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:16 2022] DELETE /identity/v3/users/b963606d8d3f424e8c7e8bc258fcb046 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:17.207644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b79e2-a26e-4873-a123-cc641999c49c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:17.208246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b79e2-a26e-4873-a123-cc641999c49c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:17.208598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b79e2-a26e-4873-a123-cc641999c49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:17.226762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-865b79e2-a26e-4873-a123-cc641999c49c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:17.227971 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-865b79e2-a26e-4873-a123-cc641999c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:17.286855 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1123/2254] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:17.296771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:17.298249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:17.355427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883e28c-dc59-49e9-9e56-a18f45c96e8c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:17.358867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549bb90-7b10-4849-9947-032e2ac467b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:17.359497 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549bb90-7b10-4849-9947-032e2ac467b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:17.359772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549bb90-7b10-4849-9947-032e2ac467b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:17.360042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549bb90-7b10-4849-9947-032e2ac467b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:17.366819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:17.369818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549bb90-7b10-4849-9947-032e2ac467b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:17.371281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549bb90-7b10-4849-9947-032e2ac467b1 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:17.380605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1132/2255] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:17.725416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b79e2-a26e-4873-a123-cc641999c49c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:17.725416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-865b79e2-a26e-4873-a123-cc641999c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:17.738154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b79e2-a26e-4873-a123-cc641999c49c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:17.749740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:17.750984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:17.751308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:17.751561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] PATH_INFO: `/v3/projects/45017bd5fdd94946a38ed47273f92102` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:17.752782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45017bd5fdd94946a38ed47273f92102)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:17.755354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:17.895148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:17.905642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45017bd5fdd94946a38ed47273f92102', 'request_id': 'req-f30c06d6-825e-4424-84ea-eacdc62475f2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:17.992306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45017bd5fdd94946a38ed47273f92102', 'request_id': 'req-f30c06d6-825e-4424-84ea-eacdc62475f2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.000799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45017bd5fdd94946a38ed47273f92102', 'request_id': 'req-f30c06d6-825e-4424-84ea-eacdc62475f2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.014208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] The token cache is being invalidate because project 45017bd5fdd94946a38ed47273f92102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:18.014497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.015146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.016671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1124/2256] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:17 2022] DELETE /identity/v3/projects/45017bd5fdd94946a38ed47273f92102 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:18.021634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549bb90-7b10-4849-9947-032e2ac467b1 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:18.032992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549bb90-7b10-4849-9947-032e2ac467b1 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:18.096736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:18.097825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:18.098294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:18.098840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] PATH_INFO: `/v3/users/897c88e6f74e4b4a8d63894b8c4aa1da` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:18.101717 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897c88e6f74e4b4a8d63894b8c4aa1da)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:18.103907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:18.374889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897c88e6f74e4b4a8d63894b8c4aa1da'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.375682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897c88e6f74e4b4a8d63894b8c4aa1da'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.460058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897c88e6f74e4b4a8d63894b8c4aa1da'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.475563 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897c88e6f74e4b4a8d63894b8c4aa1da'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.482539 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4d0b3dc-decd-453b-991c-e19aede54d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897c88e6f74e4b4a8d63894b8c4aa1da'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:18.488943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1133/2257] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:18 2022] DELETE /identity/v3/users/897c88e6f74e4b4a8d63894b8c4aa1da => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:19.023514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:19.026177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:19.062988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c06d6-825e-4424-84ea-eacdc62475f2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:19.120450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:19.121440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:19.121720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:19.121988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] PATH_INFO: `/v3/projects/9cc47a85948946b4b6ae8a290c2834f8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:19.123193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc47a85948946b4b6ae8a290c2834f8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:19.125082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:19.247447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc47a85948946b4b6ae8a290c2834f8', 'request_id': 'req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:19.387702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc47a85948946b4b6ae8a290c2834f8', 'request_id': 'req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:19.394404 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc47a85948946b4b6ae8a290c2834f8', 'request_id': 'req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:19.409491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] The token cache is being invalidate because project 9cc47a85948946b4b6ae8a290c2834f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:19.409869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:19.410601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cf6b9271-ea2f-48bc-bc21-2726f6c5d94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:19.412285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1125/2258] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:19 2022] DELETE /identity/v3/projects/9cc47a85948946b4b6ae8a290c2834f8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:19.418786 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f22ae5-6f55-444a-99ef-2561bd3a21b5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:19.419292 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f22ae5-6f55-444a-99ef-2561bd3a21b5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:19.419386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f22ae5-6f55-444a-99ef-2561bd3a21b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:19.438291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-99f22ae5-6f55-444a-99ef-2561bd3a21b5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:19.439604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-99f22ae5-6f55-444a-99ef-2561bd3a21b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:19.504180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1134/2259] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:19.513360 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7a88-47f2-455b-a5c5-f360c0a6dbdc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:19.513698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7a88-47f2-455b-a5c5-f360c0a6dbdc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:19.513988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7a88-47f2-455b-a5c5-f360c0a6dbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:19.533771 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6e4a7a88-47f2-455b-a5c5-f360c0a6dbdc None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:19.535035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6e4a7a88-47f2-455b-a5c5-f360c0a6dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:19.543333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1126/2260] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:19.547542 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f22ae5-6f55-444a-99ef-2561bd3a21b5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:19.557880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f22ae5-6f55-444a-99ef-2561bd3a21b5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:19.562600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:19.563255 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:19.563529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:19.563794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:19.564514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:44:19.564812 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:19.566446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:19.580234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1135/2261] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:44:19.584614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7a88-47f2-455b-a5c5-f360c0a6dbdc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:19.594981 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7a88-47f2-455b-a5c5-f360c0a6dbdc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:19.600979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef553b-9b15-48cd-a295-4de52851950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:19.601761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef553b-9b15-48cd-a295-4de52851950a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:19.602362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef553b-9b15-48cd-a295-4de52851950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:19.602665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef553b-9b15-48cd-a295-4de52851950a admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:19.603534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef553b-9b15-48cd-a295-4de52851950a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:19.607218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef553b-9b15-48cd-a295-4de52851950a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:19.735770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1127/2262] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:44:19 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:19.739335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:19.743543 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:19.748893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46eb8-0cd5-466a-89a0-49bc3436ca10 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:19.845750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468273-1788-4eca-8641-45adb6bdf3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:19.846489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468273-1788-4eca-8641-45adb6bdf3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:19.846777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468273-1788-4eca-8641-45adb6bdf3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:19.847057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3468273-1788-4eca-8641-45adb6bdf3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:19.849544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3468273-1788-4eca-8641-45adb6bdf3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:19.849712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3468273-1788-4eca-8641-45adb6bdf3c7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:19.927552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1136/2263] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:44:19 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:19.927816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef553b-9b15-48cd-a295-4de52851950a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:19.939738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef553b-9b15-48cd-a295-4de52851950a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:19.944817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d5ae-ca2b-464a-8da5-ea74397440ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:19.945562 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d5ae-ca2b-464a-8da5-ea74397440ce admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:19.945839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d5ae-ca2b-464a-8da5-ea74397440ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:19.946209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d5ae-ca2b-464a-8da5-ea74397440ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:19.946985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d5ae-ca2b-464a-8da5-ea74397440ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:19.948740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d5ae-ca2b-464a-8da5-ea74397440ce admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:19.962104 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1128/2264] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:19.966386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468273-1788-4eca-8641-45adb6bdf3c7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:19.979273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3468273-1788-4eca-8641-45adb6bdf3c7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:19.984165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89d53-ba3e-4408-9ad3-a6867022729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:19.989482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89d53-ba3e-4408-9ad3-a6867022729f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:19.989482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89d53-ba3e-4408-9ad3-a6867022729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:19.989482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89d53-ba3e-4408-9ad3-a6867022729f admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:19.989482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89d53-ba3e-4408-9ad3-a6867022729f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:19.989482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89d53-ba3e-4408-9ad3-a6867022729f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:20.003880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1137/2265] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:20.005430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d5ae-ca2b-464a-8da5-ea74397440ce admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:20.016923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d5ae-ca2b-464a-8da5-ea74397440ce admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:20.022816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d703f9-4381-4e3a-abad-7e3d0e114ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:20.024472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d703f9-4381-4e3a-abad-7e3d0e114ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:20.025164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d703f9-4381-4e3a-abad-7e3d0e114ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:20.025164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d703f9-4381-4e3a-abad-7e3d0e114ff2 admin admin] PATH_INFO: `/v3/projects/08035d55cadb40dbad223fb24d188b0c/users/3d33b4b7e9d24340a662b41cd008bb7c/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:20.043306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:20.044008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d703f9-4381-4e3a-abad-7e3d0e114ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08035d55cadb40dbad223fb24d188b0c, user_id=3d33b4b7e9d24340a662b41cd008bb7c, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:20.046828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d703f9-4381-4e3a-abad-7e3d0e114ff2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:20.118342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1129/2266] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:20 2022] PUT /identity/v3/projects/08035d55cadb40dbad223fb24d188b0c/users/3d33b4b7e9d24340a662b41cd008bb7c/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:20.129508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841e9bf-7c9b-45cc-ace8-9a9bf8bf3379 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:20.129791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841e9bf-7c9b-45cc-ace8-9a9bf8bf3379 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:20.130099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841e9bf-7c9b-45cc-ace8-9a9bf8bf3379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:20.157598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8841e9bf-7c9b-45cc-ace8-9a9bf8bf3379 None None] MFA Rules not processed for user `3d33b4b7e9d24340a662b41cd008bb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:20.158835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8841e9bf-7c9b-45cc-ace8-9a9bf8bf3379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:20.229004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1138/2267] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:20.233560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d703f9-4381-4e3a-abad-7e3d0e114ff2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:20.302278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d703f9-4381-4e3a-abad-7e3d0e114ff2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:20.307733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4dd61-2a62-4b26-b39f-9a5fa9e5cfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:20.308393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4dd61-2a62-4b26-b39f-9a5fa9e5cfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:20.308671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4dd61-2a62-4b26-b39f-9a5fa9e5cfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:20.308974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4dd61-2a62-4b26-b39f-9a5fa9e5cfd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:20.309668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4dd61-2a62-4b26-b39f-9a5fa9e5cfd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:20.311656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4dd61-2a62-4b26-b39f-9a5fa9e5cfd8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:20.412803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1130/2268] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:44:20 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:20.413951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841e9bf-7c9b-45cc-ace8-9a9bf8bf3379 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:20.425130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841e9bf-7c9b-45cc-ace8-9a9bf8bf3379 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:20.485339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f940-89c0-4592-8c9b-479a0a935ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:20.486026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f940-89c0-4592-8c9b-479a0a935ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:20.486326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f940-89c0-4592-8c9b-479a0a935ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:20.486662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f940-89c0-4592-8c9b-479a0a935ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:20.487344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917f940-89c0-4592-8c9b-479a0a935ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:20.489493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917f940-89c0-4592-8c9b-479a0a935ff7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:20.575729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:20.581858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1139/2269] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:44:20 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:20.585557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4dd61-2a62-4b26-b39f-9a5fa9e5cfd8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:20.596910 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4dd61-2a62-4b26-b39f-9a5fa9e5cfd8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:20.601782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a902a-9a34-43f7-a2a6-6899fc1190bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:20.602626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a902a-9a34-43f7-a2a6-6899fc1190bc admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:20.602913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a902a-9a34-43f7-a2a6-6899fc1190bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:20.603198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a902a-9a34-43f7-a2a6-6899fc1190bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:20.603923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a902a-9a34-43f7-a2a6-6899fc1190bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:20.605520 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a902a-9a34-43f7-a2a6-6899fc1190bc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:20.616619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1131/2270] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:20.621858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f940-89c0-4592-8c9b-479a0a935ff7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:20.632293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f940-89c0-4592-8c9b-479a0a935ff7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:20.637669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b52746-b4b4-4caa-b9a0-91899d708b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:20.643171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b52746-b4b4-4caa-b9a0-91899d708b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:20.643171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b52746-b4b4-4caa-b9a0-91899d708b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:20.643171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b52746-b4b4-4caa-b9a0-91899d708b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:20.643171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b52746-b4b4-4caa-b9a0-91899d708b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:20.643171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b52746-b4b4-4caa-b9a0-91899d708b20 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:20.651637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1140/2271] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:20.656182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a902a-9a34-43f7-a2a6-6899fc1190bc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:20.666327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a902a-9a34-43f7-a2a6-6899fc1190bc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:20.670947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586c10-a0fe-4f49-9711-a260841e0b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:20.671830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586c10-a0fe-4f49-9711-a260841e0b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:20.672118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586c10-a0fe-4f49-9711-a260841e0b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:20.672378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32586c10-a0fe-4f49-9711-a260841e0b9d admin admin] PATH_INFO: `/v3/projects/b3e1a3abacde47bfb7d4cf88bf9089ee/users/12ddc505348946319c001d788be48837/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:20.689435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32586c10-a0fe-4f49-9711-a260841e0b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e1a3abacde47bfb7d4cf88bf9089ee, user_id=12ddc505348946319c001d788be48837, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:20.692172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32586c10-a0fe-4f49-9711-a260841e0b9d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:20.767796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1132/2272] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:20 2022] PUT /identity/v3/projects/b3e1a3abacde47bfb7d4cf88bf9089ee/users/12ddc505348946319c001d788be48837/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:44:20.770144 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be6589-6b4f-43d0-a6cf-15ecc550248d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:20.770415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be6589-6b4f-43d0-a6cf-15ecc550248d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:20.770688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be6589-6b4f-43d0-a6cf-15ecc550248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:20.797701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b7be6589-6b4f-43d0-a6cf-15ecc550248d None None] MFA Rules not processed for user `12ddc505348946319c001d788be48837`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:20.799210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b7be6589-6b4f-43d0-a6cf-15ecc550248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:20.882601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1141/2273] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:20.887488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586c10-a0fe-4f49-9711-a260841e0b9d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:20.997535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32586c10-a0fe-4f49-9711-a260841e0b9d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:21.003147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c0d74-e69a-460c-b5b2-7ea6aa2d1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:21.003849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0d74-e69a-460c-b5b2-7ea6aa2d1393 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.004131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0d74-e69a-460c-b5b2-7ea6aa2d1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.004555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0d74-e69a-460c-b5b2-7ea6aa2d1393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.005370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c0d74-e69a-460c-b5b2-7ea6aa2d1393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:21.007490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c0d74-e69a-460c-b5b2-7ea6aa2d1393 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:21.102945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1133/2274] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:44:20 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:21.106849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be6589-6b4f-43d0-a6cf-15ecc550248d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:21.117907 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be6589-6b4f-43d0-a6cf-15ecc550248d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:21.186499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318bc60-2013-4da5-b87c-9c0a539dd13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:21.187689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bc60-2013-4da5-b87c-9c0a539dd13b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.188190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bc60-2013-4da5-b87c-9c0a539dd13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.188664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318bc60-2013-4da5-b87c-9c0a539dd13b admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.189690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318bc60-2013-4da5-b87c-9c0a539dd13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:21.192086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318bc60-2013-4da5-b87c-9c0a539dd13b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:21.272094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1142/2275] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:44:21 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:21.277348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c0d74-e69a-460c-b5b2-7ea6aa2d1393 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:21.288608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c0d74-e69a-460c-b5b2-7ea6aa2d1393 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:21.294230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:21.295014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.295296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.295570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.296307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:21.297992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:21.312686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1134/2276] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:21.316881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318bc60-2013-4da5-b87c-9c0a539dd13b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:21.329095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318bc60-2013-4da5-b87c-9c0a539dd13b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:21.334198 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c01d15-d83a-4ee9-bf7b-81a9e484f6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:21.335227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c01d15-d83a-4ee9-bf7b-81a9e484f6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.335592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c01d15-d83a-4ee9-bf7b-81a9e484f6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.336580 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c01d15-d83a-4ee9-bf7b-81a9e484f6fd admin admin] PATH_INFO: `/v3/projects/42fba2681293477bb8c77f8bf145a31d/users/baeb17fa87e349799db3f0fca0d41e56/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.355527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c01d15-d83a-4ee9-bf7b-81a9e484f6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fba2681293477bb8c77f8bf145a31d, user_id=baeb17fa87e349799db3f0fca0d41e56, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:21.358382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c01d15-d83a-4ee9-bf7b-81a9e484f6fd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:21.399942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:21.401765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:21.416294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d7697-d9f3-4db5-a563-ee2f82f551a3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:21.421459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:21.422399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.422676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.422947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] PATH_INFO: `/v3/users/43dbf6d5c8d841c79284907196a2caf5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.424569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43dbf6d5c8d841c79284907196a2caf5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:21.426317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:21.439406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:21.471726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1143/2277] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:21 2022] PUT /identity/v3/projects/42fba2681293477bb8c77f8bf145a31d/users/baeb17fa87e349799db3f0fca0d41e56/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:21.475862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c01d15-d83a-4ee9-bf7b-81a9e484f6fd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:21.530294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:21.547619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c01d15-d83a-4ee9-bf7b-81a9e484f6fd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:21.552720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee34992-4763-476e-9b39-484af5766f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:21.553588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee34992-4763-476e-9b39-484af5766f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.553885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee34992-4763-476e-9b39-484af5766f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.554339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee34992-4763-476e-9b39-484af5766f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.556092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee34992-4763-476e-9b39-484af5766f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:21.558184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee34992-4763-476e-9b39-484af5766f33 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:21.569380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1144/2278] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:44:21.575010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee34992-4763-476e-9b39-484af5766f33 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:21.585053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee34992-4763-476e-9b39-484af5766f33 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:21.590949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b1b31-b23e-413e-a1b1-fea09acb5b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:21.591928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1b31-b23e-413e-a1b1-fea09acb5b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.592272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1b31-b23e-413e-a1b1-fea09acb5b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.592551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b1b31-b23e-413e-a1b1-fea09acb5b64 admin admin] PATH_INFO: `/v3/projects/42fba2681293477bb8c77f8bf145a31d/users/baeb17fa87e349799db3f0fca0d41e56/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.594608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1b31-b23e-413e-a1b1-fea09acb5b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42fba2681293477bb8c77f8bf145a31d, user_id=baeb17fa87e349799db3f0fca0d41e56, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:21.597316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b1b31-b23e-413e-a1b1-fea09acb5b64 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:21.613513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1145/2279] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:21 2022] PUT /identity/v3/projects/42fba2681293477bb8c77f8bf145a31d/users/baeb17fa87e349799db3f0fca0d41e56/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:21.626287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4e753-038b-4bb4-8985-7af7e1031f32 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.626723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4e753-038b-4bb4-8985-7af7e1031f32 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.627007 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4e753-038b-4bb4-8985-7af7e1031f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.666807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-82c4e753-038b-4bb4-8985-7af7e1031f32 None None] MFA Rules not processed for user `baeb17fa87e349799db3f0fca0d41e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:21.668672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-82c4e753-038b-4bb4-8985-7af7e1031f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:21.674509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43dbf6d5c8d841c79284907196a2caf5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:21.751580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43dbf6d5c8d841c79284907196a2caf5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:21.759288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1146/2280] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:21.772940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43dbf6d5c8d841c79284907196a2caf5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:21.774423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43dbf6d5c8d841c79284907196a2caf5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:21.774852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4e753-038b-4bb4-8985-7af7e1031f32 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:21.777370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-82c4e753-038b-4bb4-8985-7af7e1031f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:21.790989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8bc78e76-d087-4762-8e0f-b337883ca50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43dbf6d5c8d841c79284907196a2caf5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:21.798775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1135/2281] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:21 2022] DELETE /identity/v3/users/43dbf6d5c8d841c79284907196a2caf5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:44:21.803615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cab77-24ff-4884-8580-61d77d4e679b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.803875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cab77-24ff-4884-8580-61d77d4e679b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.804256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cab77-24ff-4884-8580-61d77d4e679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.825335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6d5cab77-24ff-4884-8580-61d77d4e679b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:21.826871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d5cab77-24ff-4884-8580-61d77d4e679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:21.861309 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4e753-038b-4bb4-8985-7af7e1031f32 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:21.910686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1136/2282] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:44:21.918373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cab77-24ff-4884-8580-61d77d4e679b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:21.920741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d5cab77-24ff-4884-8580-61d77d4e679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:21.933226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:21.934173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:21.934461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:21.935056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:21.936582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:21.960999 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:22.013773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:22.014695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cab77-24ff-4884-8580-61d77d4e679b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:22.015276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:22.024396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b9f2a-7e87-41c6-87d9-17a8f55da5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:22.025183 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b9f2a-7e87-41c6-87d9-17a8f55da5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:22.025540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b9f2a-7e87-41c6-87d9-17a8f55da5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:22.025890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b9f2a-7e87-41c6-87d9-17a8f55da5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:22.048016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1147/2283] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:22.054622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b9f2a-7e87-41c6-87d9-17a8f55da5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:22.059798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b9f2a-7e87-41c6-87d9-17a8f55da5b8 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:22.074621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1137/2284] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:44:22.616925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:22.619489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:22.645674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586168d-9937-4a48-8262-796294f776a3 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:22.651480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:22.652301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:22.652676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:22.653020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] PATH_INFO: `/v3/projects/a0df26a4bec14c4a8916df9f0cfcb9f6` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:22.654248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0df26a4bec14c4a8916df9f0cfcb9f6)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:22.656165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:22.781649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0df26a4bec14c4a8916df9f0cfcb9f6', 'request_id': 'req-24839907-3fec-4fcc-b3cc-ee8b84edda5e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:22.860882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0df26a4bec14c4a8916df9f0cfcb9f6', 'request_id': 'req-24839907-3fec-4fcc-b3cc-ee8b84edda5e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:22.872796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0df26a4bec14c4a8916df9f0cfcb9f6', 'request_id': 'req-24839907-3fec-4fcc-b3cc-ee8b84edda5e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:22.890277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] The token cache is being invalidate because project a0df26a4bec14c4a8916df9f0cfcb9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:22.894185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:22.894185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-24839907-3fec-4fcc-b3cc-ee8b84edda5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:22.894185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1148/2285] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:22 2022] DELETE /identity/v3/projects/a0df26a4bec14c4a8916df9f0cfcb9f6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:22.898422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356183-77c2-47be-b7ec-997f17cd9ac2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:22.898982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356183-77c2-47be-b7ec-997f17cd9ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:22.899189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356183-77c2-47be-b7ec-997f17cd9ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:22.919012 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1c356183-77c2-47be-b7ec-997f17cd9ac2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:22.919803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1c356183-77c2-47be-b7ec-997f17cd9ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:22.950118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:22.985019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1138/2286] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:22.994529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966cedb-b6cb-49e9-bf44-b23c11a6c594 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:22.994833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966cedb-b6cb-49e9-bf44-b23c11a6c594 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:22.995179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966cedb-b6cb-49e9-bf44-b23c11a6c594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.014805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3966cedb-b6cb-49e9-bf44-b23c11a6c594 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:23.016043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3966cedb-b6cb-49e9-bf44-b23c11a6c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:23.024365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1149/2287] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:23.028735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356183-77c2-47be-b7ec-997f17cd9ac2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:23.038597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356183-77c2-47be-b7ec-997f17cd9ac2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:23.043525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:23.044189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.044467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.044743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.045463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:44:23.045765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:23.047535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:23.070027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1139/2288] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:44:23.075197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966cedb-b6cb-49e9-bf44-b23c11a6c594 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:23.084103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966cedb-b6cb-49e9-bf44-b23c11a6c594 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:23.089026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a95a29-5275-48e2-8aaf-c9d671140dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:23.089672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a95a29-5275-48e2-8aaf-c9d671140dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.089948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a95a29-5275-48e2-8aaf-c9d671140dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.090254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a95a29-5275-48e2-8aaf-c9d671140dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.090945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a95a29-5275-48e2-8aaf-c9d671140dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:23.093110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a95a29-5275-48e2-8aaf-c9d671140dc3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:23.185006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1150/2289] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:44:23 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:23.186356 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:23.197234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e62c7-b3b7-455c-a412-2af69e467d67 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:23.259783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d447d-80ee-4557-9166-c4409cb76df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:23.260605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d447d-80ee-4557-9166-c4409cb76df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.260988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d447d-80ee-4557-9166-c4409cb76df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.261378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d447d-80ee-4557-9166-c4409cb76df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.262102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d447d-80ee-4557-9166-c4409cb76df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:23.264044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d447d-80ee-4557-9166-c4409cb76df3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:23.357818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1140/2290] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:44:23 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:23.362133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a95a29-5275-48e2-8aaf-c9d671140dc3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:23.373146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a95a29-5275-48e2-8aaf-c9d671140dc3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:23.377913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934a02-3d10-4add-b077-33de2106b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:23.378602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934a02-3d10-4add-b077-33de2106b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.378878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934a02-3d10-4add-b077-33de2106b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.379150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934a02-3d10-4add-b077-33de2106b0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.380464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07934a02-3d10-4add-b077-33de2106b0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:23.381451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07934a02-3d10-4add-b077-33de2106b0d9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:23.392484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1151/2291] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:23.396429 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d447d-80ee-4557-9166-c4409cb76df3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:23.406641 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d447d-80ee-4557-9166-c4409cb76df3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:23.411165 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad18e74-41fc-43f1-805b-357b4712ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:23.411821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18e74-41fc-43f1-805b-357b4712ea15 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.412101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18e74-41fc-43f1-805b-357b4712ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.412377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18e74-41fc-43f1-805b-357b4712ea15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.413105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad18e74-41fc-43f1-805b-357b4712ea15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:23.415509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad18e74-41fc-43f1-805b-357b4712ea15 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:23.425762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1141/2292] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:23.429932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934a02-3d10-4add-b077-33de2106b0d9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:23.441899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934a02-3d10-4add-b077-33de2106b0d9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:23.446802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:23.447734 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.449339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.449339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] PATH_INFO: `/v3/projects/fbda1f2d191a42e683194238efad310f/users/1b2402b605da4e96b3c63562d0635410/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.463790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbda1f2d191a42e683194238efad310f, user_id=1b2402b605da4e96b3c63562d0635410, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:23.466478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:23.587403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1152/2293] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:23 2022] PUT /identity/v3/projects/fbda1f2d191a42e683194238efad310f/users/1b2402b605da4e96b3c63562d0635410/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:23.597507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db326-16d6-42f8-a3b8-6173118e7874 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.597794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db326-16d6-42f8-a3b8-6173118e7874 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.598096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db326-16d6-42f8-a3b8-6173118e7874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.625474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-eb0db326-16d6-42f8-a3b8-6173118e7874 None None] MFA Rules not processed for user `1b2402b605da4e96b3c63562d0635410`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:23.626737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eb0db326-16d6-42f8-a3b8-6173118e7874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:23.693357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1142/2294] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:23.704791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:23.706767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:23.759157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:23.770701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167c509-0abd-4abc-b44d-8924bdfecabc admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:23.775076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:23.775745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.776058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.776328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.784977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:23.786437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:23.795367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1153/2295] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:23.841965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74415998-90df-4ed6-87a2-f971604ce419 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:23.842341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74415998-90df-4ed6-87a2-f971604ce419 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:23.842580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74415998-90df-4ed6-87a2-f971604ce419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:23.860930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-74415998-90df-4ed6-87a2-f971604ce419 None None] MFA Rules not processed for user `be51e8b84bb7471bb17409b331e599eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:23.862201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-74415998-90df-4ed6-87a2-f971604ce419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:23.884692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:23.921436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1143/2296] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:24.416163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:24.417592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:24.429016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a531b-aff6-4c7a-905c-97faa453e8e1 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:24.439308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:24.439308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:24.439308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:24.439308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:24.439939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:24.509182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:24.510934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:24.521067 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1154/2297] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:26.142792 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74415998-90df-4ed6-87a2-f971604ce419 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:26.153631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74415998-90df-4ed6-87a2-f971604ce419 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:26.157357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:26.157988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:26.158298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:26.158576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:26.160358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:26.227186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:26.228628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:26.238905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1144/2298] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:34.314044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:34.315504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:34.379093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fa2b9-fce5-42d8-81ed-6049c206d63a service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:34.383607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:34.384466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:34.384746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:34.385017 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] PATH_INFO: `/v3/users/059633d521f247b785831d9d77a9e05e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:34.386306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059633d521f247b785831d9d77a9e05e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:34.388307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:34.535860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059633d521f247b785831d9d77a9e05e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:34.536464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059633d521f247b785831d9d77a9e05e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:34.630676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059633d521f247b785831d9d77a9e05e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:34.643041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059633d521f247b785831d9d77a9e05e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:34.649945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059633d521f247b785831d9d77a9e05e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:34.656689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1155/2299] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:34 2022] DELETE /identity/v3/users/059633d521f247b785831d9d77a9e05e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:34.894219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:34.905112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd8621-7607-4272-ad2a-74fa3bcd327c service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:34.962789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:34.963651 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:34.963998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:34.964273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] PATH_INFO: `/v3/projects/c0bd63e1295e4801885f2bc9c6212fb6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:34.965502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bd63e1295e4801885f2bc9c6212fb6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:34.967450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:35.048453 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bd63e1295e4801885f2bc9c6212fb6', 'request_id': 'req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.105510 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bd63e1295e4801885f2bc9c6212fb6', 'request_id': 'req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.111332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bd63e1295e4801885f2bc9c6212fb6', 'request_id': 'req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.113286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:35.123283 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] The token cache is being invalidate because project c0bd63e1295e4801885f2bc9c6212fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:35.123572 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.124198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.125730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1145/2300] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:34 2022] DELETE /identity/v3/projects/c0bd63e1295e4801885f2bc9c6212fb6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:35.129675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:35.131085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:35.139025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:35.144151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da040e-1061-497e-922a-925f78284df3 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:35.200444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:35.201313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:35.201591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:35.201863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] PATH_INFO: `/v3/users/c1d9137ae0c74ccdae3a33254fe8534d` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:35.203073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d9137ae0c74ccdae3a33254fe8534d)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:35.204988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:35.382371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d9137ae0c74ccdae3a33254fe8534d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.383032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d9137ae0c74ccdae3a33254fe8534d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.430677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d9137ae0c74ccdae3a33254fe8534d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.444658 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d9137ae0c74ccdae3a33254fe8534d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.451905 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-fcac2ff5-7756-45aa-affc-8cbeebd58274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d9137ae0c74ccdae3a33254fe8534d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.457894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1156/2301] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:35 2022] DELETE /identity/v3/users/c1d9137ae0c74ccdae3a33254fe8534d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:44:35.723362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:35.724773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:35.738540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908abc2-7dd6-4cb6-b779-f7e52c2ac52b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:35.796451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:35.797357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:35.797661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:35.797933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] PATH_INFO: `/v3/projects/b41cba4d014f4bc4a22af01404fb6d69` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:35.799131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41cba4d014f4bc4a22af01404fb6d69)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:35.801048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:35.916822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41cba4d014f4bc4a22af01404fb6d69', 'request_id': 'req-d304bc98-2122-4c61-b840-138e8c792534'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.983795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41cba4d014f4bc4a22af01404fb6d69', 'request_id': 'req-d304bc98-2122-4c61-b840-138e8c792534'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:35.989548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41cba4d014f4bc4a22af01404fb6d69', 'request_id': 'req-d304bc98-2122-4c61-b840-138e8c792534'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:36.001531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] The token cache is being invalidate because project b41cba4d014f4bc4a22af01404fb6d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:36.004871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:36.004871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d304bc98-2122-4c61-b840-138e8c792534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:36.004871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1146/2302] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:35 2022] DELETE /identity/v3/projects/b41cba4d014f4bc4a22af01404fb6d69 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:36.008748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4c7-94ac-4d9a-9113-7b831232433c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.009028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4c7-94ac-4d9a-9113-7b831232433c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.009297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d4c7-94ac-4d9a-9113-7b831232433c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.027272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-78b3d4c7-94ac-4d9a-9113-7b831232433c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:36.028451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-78b3d4c7-94ac-4d9a-9113-7b831232433c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:36.088612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1157/2303] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:36.096533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b62e7-7229-417c-9488-5b907b785c72 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.096823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b62e7-7229-417c-9488-5b907b785c72 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.097103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b62e7-7229-417c-9488-5b907b785c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.115316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f37b62e7-7229-417c-9488-5b907b785c72 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:36.116522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f37b62e7-7229-417c-9488-5b907b785c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:36.125102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1147/2304] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:36.129137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d4c7-94ac-4d9a-9113-7b831232433c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:36.139466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d4c7-94ac-4d9a-9113-7b831232433c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:36.144043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:36.144682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.144960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.145234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.145956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:44:36.146289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:36.147881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:36.159180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1158/2305] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:44:36.163435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b62e7-7229-417c-9488-5b907b785c72 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:36.172999 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b62e7-7229-417c-9488-5b907b785c72 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:36.177870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0e53-1d86-4d59-855b-0bf417d07bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:36.178539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0e53-1d86-4d59-855b-0bf417d07bda admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.178823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0e53-1d86-4d59-855b-0bf417d07bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.179097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa0e53-1d86-4d59-855b-0bf417d07bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.179791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa0e53-1d86-4d59-855b-0bf417d07bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:36.181666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa0e53-1d86-4d59-855b-0bf417d07bda admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:36.267599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1148/2306] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:44:36 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:44:36.271564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:36.281473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f286a8-d4f9-4b9b-9dfb-84d831adc2de admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:36.285989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:36.338087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55918-0b19-49d3-af98-9ac751c4d2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:36.339083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55918-0b19-49d3-af98-9ac751c4d2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.339551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55918-0b19-49d3-af98-9ac751c4d2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.340228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55918-0b19-49d3-af98-9ac751c4d2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.341054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd55918-0b19-49d3-af98-9ac751c4d2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:36.343083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd55918-0b19-49d3-af98-9ac751c4d2d4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:36.413933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1159/2307] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:44:36 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:44:36.418557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0e53-1d86-4d59-855b-0bf417d07bda admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:36.429123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa0e53-1d86-4d59-855b-0bf417d07bda admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:36.434454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f205341-573c-446d-b57c-419fb95b593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:36.435099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205341-573c-446d-b57c-419fb95b593e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.435374 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205341-573c-446d-b57c-419fb95b593e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.435643 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205341-573c-446d-b57c-419fb95b593e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.436358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f205341-573c-446d-b57c-419fb95b593e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:36.437921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f205341-573c-446d-b57c-419fb95b593e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:36.449437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1149/2308] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:36.452681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55918-0b19-49d3-af98-9ac751c4d2d4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:36.465444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55918-0b19-49d3-af98-9ac751c4d2d4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:36.469464 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b8e33-a580-4138-a5d1-775e9dfdbe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:36.470257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8e33-a580-4138-a5d1-775e9dfdbe56 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.470426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8e33-a580-4138-a5d1-775e9dfdbe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.470697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b8e33-a580-4138-a5d1-775e9dfdbe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.471425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b8e33-a580-4138-a5d1-775e9dfdbe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:36.473104 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b8e33-a580-4138-a5d1-775e9dfdbe56 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:36.483559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1160/2309] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:36.487710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f205341-573c-446d-b57c-419fb95b593e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:36.497776 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f205341-573c-446d-b57c-419fb95b593e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:36.502863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:36.511568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.511568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.511568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] PATH_INFO: `/v3/projects/d2a3bb9085e244b68b849e5ca3363f34/users/40847e58131044ab9cd1166f43ca5852/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.569117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a3bb9085e244b68b849e5ca3363f34, user_id=40847e58131044ab9cd1166f43ca5852, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:36.571830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:36.647932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1150/2310] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:36 2022] PUT /identity/v3/projects/d2a3bb9085e244b68b849e5ca3363f34/users/40847e58131044ab9cd1166f43ca5852/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:36.659614 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a5b5-1851-46b5-bd71-3d80ca4551b5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.659899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a5b5-1851-46b5-bd71-3d80ca4551b5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.660172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309a5b5-1851-46b5-bd71-3d80ca4551b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.688698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8309a5b5-1851-46b5-bd71-3d80ca4551b5 None None] MFA Rules not processed for user `40847e58131044ab9cd1166f43ca5852`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:36.689950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8309a5b5-1851-46b5-bd71-3d80ca4551b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:36.752857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1161/2311] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:44:36.764676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:36.766353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:36.791654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:36.844523 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e2d89-8da5-4cf2-a095-2faeceedddc8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:36.848839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aabc1d-1566-4f92-bf38-f7e9eb001d36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7d46c2766b4481963adefebea94c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:36.849487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aabc1d-1566-4f92-bf38-f7e9eb001d36 service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:36.849769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aabc1d-1566-4f92-bf38-f7e9eb001d36 service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:36.850072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aabc1d-1566-4f92-bf38-f7e9eb001d36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:36.858789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aabc1d-1566-4f92-bf38-f7e9eb001d36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:36.860200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aabc1d-1566-4f92-bf38-f7e9eb001d36 service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:36.868846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1151/2312] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:39.529051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309a5b5-1851-46b5-bd71-3d80ca4551b5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:39.530468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8309a5b5-1851-46b5-bd71-3d80ca4551b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:39.614195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309a5b5-1851-46b5-bd71-3d80ca4551b5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:39.618720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:39.619574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:39.619849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:39.620762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] PATH_INFO: `/v3/users/3d33b4b7e9d24340a662b41cd008bb7c` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:39.621918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d33b4b7e9d24340a662b41cd008bb7c)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:39.623868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:39.644027 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:39.838642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d33b4b7e9d24340a662b41cd008bb7c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:39.839909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d33b4b7e9d24340a662b41cd008bb7c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:39.921529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d33b4b7e9d24340a662b41cd008bb7c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:39.934313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d33b4b7e9d24340a662b41cd008bb7c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:39.941129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d33b4b7e9d24340a662b41cd008bb7c'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:39.946981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1162/2313] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:39 2022] DELETE /identity/v3/users/3d33b4b7e9d24340a662b41cd008bb7c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:39.951438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4303ae-748d-410c-b1e8-d56681cf503a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:39.951903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4303ae-748d-410c-b1e8-d56681cf503a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:39.952025 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4303ae-748d-410c-b1e8-d56681cf503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:39.970802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6b4303ae-748d-410c-b1e8-d56681cf503a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:39.972119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6b4303ae-748d-410c-b1e8-d56681cf503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:40.044250 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1152/2314] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:40.055154 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:40.057174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:40.121668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911264b-4583-4a7e-ba76-b96afdd329bb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:40.125451 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76256-a755-4c5f-a6cf-fa237f6e9455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:40.126131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76256-a755-4c5f-a6cf-fa237f6e9455 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:40.126414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76256-a755-4c5f-a6cf-fa237f6e9455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:40.126688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b76256-a755-4c5f-a6cf-fa237f6e9455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:40.137358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76256-a755-4c5f-a6cf-fa237f6e9455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:40.138817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b76256-a755-4c5f-a6cf-fa237f6e9455 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:40.150639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1163/2315] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:44:40.576037 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4303ae-748d-410c-b1e8-d56681cf503a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:40.577497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6b4303ae-748d-410c-b1e8-d56681cf503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:40.589439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4303ae-748d-410c-b1e8-d56681cf503a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:40.593951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:40.594842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:40.595123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:40.595394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] PATH_INFO: `/v3/projects/08035d55cadb40dbad223fb24d188b0c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:40.596582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08035d55cadb40dbad223fb24d188b0c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:40.598516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:40.706630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08035d55cadb40dbad223fb24d188b0c', 'request_id': 'req-4a310cb5-b147-403c-9717-b87dddfdc019'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:40.773732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08035d55cadb40dbad223fb24d188b0c', 'request_id': 'req-4a310cb5-b147-403c-9717-b87dddfdc019'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:40.780151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08035d55cadb40dbad223fb24d188b0c', 'request_id': 'req-4a310cb5-b147-403c-9717-b87dddfdc019'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:40.791402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] The token cache is being invalidate because project 08035d55cadb40dbad223fb24d188b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:40.791684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:40.792325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:40.793844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1153/2316] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:40 2022] DELETE /identity/v3/projects/08035d55cadb40dbad223fb24d188b0c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:40.798663 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76256-a755-4c5f-a6cf-fa237f6e9455 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:40.809323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b76256-a755-4c5f-a6cf-fa237f6e9455 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:40.867955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:40.868857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:40.869145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:40.869535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] PATH_INFO: `/v3/users/12ddc505348946319c001d788be48837` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:40.871394 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ddc505348946319c001d788be48837)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:40.873384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:41.021811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:41.026516 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ddc505348946319c001d788be48837'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:41.027153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ddc505348946319c001d788be48837'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:41.087751 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ddc505348946319c001d788be48837'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:41.099855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ddc505348946319c001d788be48837'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:41.107000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ddc505348946319c001d788be48837'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:41.113832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1164/2317] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:40 2022] DELETE /identity/v3/users/12ddc505348946319c001d788be48837 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:44:41.769334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:41.770815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:41.786298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a310cb5-b147-403c-9717-b87dddfdc019 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:41.815005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:41.847029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:41.847934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:41.848271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:41.848616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] PATH_INFO: `/v3/projects/b3e1a3abacde47bfb7d4cf88bf9089ee` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:41.849756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e1a3abacde47bfb7d4cf88bf9089ee)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:41.851741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:41.968496 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e1a3abacde47bfb7d4cf88bf9089ee', 'request_id': 'req-aa656907-eeaf-4f8b-b265-4df85ab0edfa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.042205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e1a3abacde47bfb7d4cf88bf9089ee', 'request_id': 'req-aa656907-eeaf-4f8b-b265-4df85ab0edfa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.048370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e1a3abacde47bfb7d4cf88bf9089ee', 'request_id': 'req-aa656907-eeaf-4f8b-b265-4df85ab0edfa'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.060306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] The token cache is being invalidate because project b3e1a3abacde47bfb7d4cf88bf9089ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:42.060590 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.061256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.070649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1154/2318] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:41 2022] DELETE /identity/v3/projects/b3e1a3abacde47bfb7d4cf88bf9089ee => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:42.071376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:42.071376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:42.081620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03535b-aa3f-4dd8-90fe-f36ba34033fc admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:42.140100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:42.140892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:42.141180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:42.141449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] PATH_INFO: `/v3/users/baeb17fa87e349799db3f0fca0d41e56` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:42.142631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baeb17fa87e349799db3f0fca0d41e56)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:42.144534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:42.370612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baeb17fa87e349799db3f0fca0d41e56'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.371494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baeb17fa87e349799db3f0fca0d41e56'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.458981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baeb17fa87e349799db3f0fca0d41e56'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.471305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baeb17fa87e349799db3f0fca0d41e56'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.481754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3f22667c-5699-436e-a97c-4c5e51253d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baeb17fa87e349799db3f0fca0d41e56'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:42.488783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1165/2319] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:42 2022] DELETE /identity/v3/users/baeb17fa87e349799db3f0fca0d41e56 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:42.981039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:42.982533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:42.997746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa656907-eeaf-4f8b-b265-4df85ab0edfa admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:43.071546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:43.072408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.072693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.075791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] PATH_INFO: `/v3/projects/42fba2681293477bb8c77f8bf145a31d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.075791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=42fba2681293477bb8c77f8bf145a31d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:43.076870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:43.178262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42fba2681293477bb8c77f8bf145a31d', 'request_id': 'req-60e734b8-fbe5-48f7-96e2-45465e62a31f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:43.247248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42fba2681293477bb8c77f8bf145a31d', 'request_id': 'req-60e734b8-fbe5-48f7-96e2-45465e62a31f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:43.251251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:43.253486 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42fba2681293477bb8c77f8bf145a31d', 'request_id': 'req-60e734b8-fbe5-48f7-96e2-45465e62a31f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:43.265339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] The token cache is being invalidate because project 42fba2681293477bb8c77f8bf145a31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:43.265622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:43.266284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-60e734b8-fbe5-48f7-96e2-45465e62a31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:43.267838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1155/2320] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:42 2022] DELETE /identity/v3/projects/42fba2681293477bb8c77f8bf145a31d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:43.272683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6a52-022a-45f2-b6f7-dcc231f04d8c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.273139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6a52-022a-45f2-b6f7-dcc231f04d8c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.273266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6a52-022a-45f2-b6f7-dcc231f04d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.291837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-acad6a52-022a-45f2-b6f7-dcc231f04d8c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:43.293033 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-acad6a52-022a-45f2-b6f7-dcc231f04d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:43.330418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:43.359008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1166/2321] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:43.367752 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a570-2b8e-40d9-bef2-ec3366113469 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.368040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a570-2b8e-40d9-bef2-ec3366113469 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.368317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a570-2b8e-40d9-bef2-ec3366113469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.387167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-70a4a570-2b8e-40d9-bef2-ec3366113469 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:43.388366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-70a4a570-2b8e-40d9-bef2-ec3366113469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:43.396294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1156/2322] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:43.400541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6a52-022a-45f2-b6f7-dcc231f04d8c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:43.419383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6a52-022a-45f2-b6f7-dcc231f04d8c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:43.419383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:43.419383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.419383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.419858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.419858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:44:43.419858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:43.420206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:43.432025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1167/2323] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:44:43.437006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4a570-2b8e-40d9-bef2-ec3366113469 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:43.446227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4a570-2b8e-40d9-bef2-ec3366113469 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:43.451982 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8b40-57d1-4014-9c8d-9419394a543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:43.452627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8b40-57d1-4014-9c8d-9419394a543b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.452906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8b40-57d1-4014-9c8d-9419394a543b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.453176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8b40-57d1-4014-9c8d-9419394a543b admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.453854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8b40-57d1-4014-9c8d-9419394a543b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:43.455821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8b40-57d1-4014-9c8d-9419394a543b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:43.562846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1157/2324] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:44:43 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:44:43.566936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:43.577759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869e76-056b-4411-8417-bf141ccbce98 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:43.633317 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c110a6-4cab-4212-81db-21fa3f9d8d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:43.633962 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c110a6-4cab-4212-81db-21fa3f9d8d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.634277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c110a6-4cab-4212-81db-21fa3f9d8d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.634550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c110a6-4cab-4212-81db-21fa3f9d8d29 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.635243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c110a6-4cab-4212-81db-21fa3f9d8d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:43.637816 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c110a6-4cab-4212-81db-21fa3f9d8d29 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:43.778418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1168/2325] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:44:43 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:44:43.782498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8b40-57d1-4014-9c8d-9419394a543b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:43.792775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8b40-57d1-4014-9c8d-9419394a543b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:43.797605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0cb6a-6286-4fde-ba02-aeb251186045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:43.798294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cb6a-6286-4fde-ba02-aeb251186045 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.798579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cb6a-6286-4fde-ba02-aeb251186045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.798857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cb6a-6286-4fde-ba02-aeb251186045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.799707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0cb6a-6286-4fde-ba02-aeb251186045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:43.801316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0cb6a-6286-4fde-ba02-aeb251186045 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:43.814778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1158/2326] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:43.817675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c110a6-4cab-4212-81db-21fa3f9d8d29 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:43.828838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c110a6-4cab-4212-81db-21fa3f9d8d29 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:43.833470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5887-9bfa-47ec-9ea5-0a497adec2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:43.834160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5887-9bfa-47ec-9ea5-0a497adec2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.834440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5887-9bfa-47ec-9ea5-0a497adec2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.834704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5887-9bfa-47ec-9ea5-0a497adec2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.835420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5887-9bfa-47ec-9ea5-0a497adec2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:43.836989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5887-9bfa-47ec-9ea5-0a497adec2b0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:43.848035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1169/2327] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:43.851852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0cb6a-6286-4fde-ba02-aeb251186045 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:43.862407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0cb6a-6286-4fde-ba02-aeb251186045 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:43.866896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:43.867764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.868038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.868308 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] PATH_INFO: `/v3/projects/6cc864fdafab4ddb8dad415abb24781a/users/8598a55eaa5d4749baabdfc4ff2bb50a/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:43.884634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc864fdafab4ddb8dad415abb24781a, user_id=8598a55eaa5d4749baabdfc4ff2bb50a, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:43.887554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:43.968535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1159/2328] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:43 2022] PUT /identity/v3/projects/6cc864fdafab4ddb8dad415abb24781a/users/8598a55eaa5d4749baabdfc4ff2bb50a/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:44:43.978585 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c8688-15a8-4859-9a3f-8f9b8edd8bbb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:43.979042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c8688-15a8-4859-9a3f-8f9b8edd8bbb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:43.980138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c8688-15a8-4859-9a3f-8f9b8edd8bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:44.007419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-781c8688-15a8-4859-9a3f-8f9b8edd8bbb None None] MFA Rules not processed for user `8598a55eaa5d4749baabdfc4ff2bb50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:44.008608 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-781c8688-15a8-4859-9a3f-8f9b8edd8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:44.074319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1170/2329] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:44.085554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:44.087515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:44.149224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce03579-04e9-47af-8b01-13564ae2720c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:44.153387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d658d2d-9948-4fd0-b2c4-b9e6efdab37b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:44.154064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d658d2d-9948-4fd0-b2c4-b9e6efdab37b service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:44.154351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d658d2d-9948-4fd0-b2c4-b9e6efdab37b service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:44.154627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d658d2d-9948-4fd0-b2c4-b9e6efdab37b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:44.163093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d658d2d-9948-4fd0-b2c4-b9e6efdab37b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:44.164552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d658d2d-9948-4fd0-b2c4-b9e6efdab37b service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:44.173832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1160/2330] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:53.981918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c8688-15a8-4859-9a3f-8f9b8edd8bbb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:53.983827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-781c8688-15a8-4859-9a3f-8f9b8edd8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:54.020064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:54.052712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c8688-15a8-4859-9a3f-8f9b8edd8bbb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:54.058171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:54.059053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:54.059757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:54.060046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] PATH_INFO: `/v3/users/1b2402b605da4e96b3c63562d0635410` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:54.062073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2402b605da4e96b3c63562d0635410)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:54.063779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:54.170479 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=1,keystone:SELECT=57,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:54.244046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2402b605da4e96b3c63562d0635410'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:54.244683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2402b605da4e96b3c63562d0635410'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:54.332192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2402b605da4e96b3c63562d0635410'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:54.345119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2402b605da4e96b3c63562d0635410'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:54.352472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2402b605da4e96b3c63562d0635410'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:54.359389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1171/2331] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:44:53 2022] DELETE /identity/v3/users/1b2402b605da4e96b3c63562d0635410 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:54.363905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1393-58a3-4a08-bf1a-b924d98eb72b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:54.364192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1393-58a3-4a08-bf1a-b924d98eb72b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:54.364472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1393-58a3-4a08-bf1a-b924d98eb72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:54.381398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-530f1393-58a3-4a08-bf1a-b924d98eb72b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:54.382699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-530f1393-58a3-4a08-bf1a-b924d98eb72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:54.460990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1161/2332] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:54.477569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:54.477569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:54.539046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a39d34-0397-4ef8-8b06-125c5d1256a6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:54.542737 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdd85e-b6b5-4b5f-933c-bc5a55f4b6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:54.543382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd85e-b6b5-4b5f-933c-bc5a55f4b6fe service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:54.543663 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd85e-b6b5-4b5f-933c-bc5a55f4b6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:54.543939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdd85e-b6b5-4b5f-933c-bc5a55f4b6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:54.553691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdd85e-b6b5-4b5f-933c-bc5a55f4b6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:54.555161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdd85e-b6b5-4b5f-933c-bc5a55f4b6fe service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:54.565475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1172/2333] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:44:54.997773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f1393-58a3-4a08-bf1a-b924d98eb72b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:55.001117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-530f1393-58a3-4a08-bf1a-b924d98eb72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:55.015535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f1393-58a3-4a08-bf1a-b924d98eb72b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:55.020423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:55.022614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.022614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.022614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] PATH_INFO: `/v3/projects/fbda1f2d191a42e683194238efad310f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.023710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbda1f2d191a42e683194238efad310f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:55.025942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:55.150324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbda1f2d191a42e683194238efad310f', 'request_id': 'req-63427bd1-90fc-47dc-9007-83a1cd50da9a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:55.241045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbda1f2d191a42e683194238efad310f', 'request_id': 'req-63427bd1-90fc-47dc-9007-83a1cd50da9a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:55.248872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbda1f2d191a42e683194238efad310f', 'request_id': 'req-63427bd1-90fc-47dc-9007-83a1cd50da9a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:55.261098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] The token cache is being invalidate because project fbda1f2d191a42e683194238efad310f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:44:55.261423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:55.262121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-63427bd1-90fc-47dc-9007-83a1cd50da9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:44:55.263777 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1162/2334] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:44:54 2022] DELETE /identity/v3/projects/fbda1f2d191a42e683194238efad310f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:44:55.268944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1eba4-cca8-40b3-95b7-1385aeee5acb None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.269447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1eba4-cca8-40b3-95b7-1385aeee5acb None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.269728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1eba4-cca8-40b3-95b7-1385aeee5acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.290064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c2f1eba4-cca8-40b3-95b7-1385aeee5acb None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:55.291996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c2f1eba4-cca8-40b3-95b7-1385aeee5acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:55.354627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:55.365960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1173/2335] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:55.374789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c926-c9d3-4e69-8698-a9789aaf25a8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.375689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c926-c9d3-4e69-8698-a9789aaf25a8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.375989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81c926-c9d3-4e69-8698-a9789aaf25a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.396233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0c81c926-c9d3-4e69-8698-a9789aaf25a8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:55.398220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0c81c926-c9d3-4e69-8698-a9789aaf25a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:55.408382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1163/2336] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:55.412270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1eba4-cca8-40b3-95b7-1385aeee5acb None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:55.422713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1eba4-cca8-40b3-95b7-1385aeee5acb None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:55.427815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:55.433521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.433521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.433521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.433521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:44:55.433521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:55.433521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:55.446034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1174/2337] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:44:55.448393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81c926-c9d3-4e69-8698-a9789aaf25a8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:55.458381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81c926-c9d3-4e69-8698-a9789aaf25a8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:55.463628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac52403-b321-4188-b2b8-13065ec3fdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:55.464286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac52403-b321-4188-b2b8-13065ec3fdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.464577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac52403-b321-4188-b2b8-13065ec3fdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.464848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac52403-b321-4188-b2b8-13065ec3fdd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.465554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac52403-b321-4188-b2b8-13065ec3fdd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:55.467566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac52403-b321-4188-b2b8-13065ec3fdd4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:55.580961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1164/2338] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:44:55 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:44:55.585290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:55.595406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959c737-9d5c-47fb-b49c-9ac63c83b59f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:55.665010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdcd4-0e7d-4c79-b13f-9cd25df7509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:55.665686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdcd4-0e7d-4c79-b13f-9cd25df7509c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.665971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdcd4-0e7d-4c79-b13f-9cd25df7509c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.666281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdcd4-0e7d-4c79-b13f-9cd25df7509c admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.667284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cdcd4-0e7d-4c79-b13f-9cd25df7509c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:55.669613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cdcd4-0e7d-4c79-b13f-9cd25df7509c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:55.728156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1175/2339] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:44:55 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:44:55.731869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac52403-b321-4188-b2b8-13065ec3fdd4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:55.743884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac52403-b321-4188-b2b8-13065ec3fdd4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:55.749945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849c0b1-a3ed-4c43-a1bc-8b923570a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:55.750523 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c0b1-a3ed-4c43-a1bc-8b923570a337 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.750801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c0b1-a3ed-4c43-a1bc-8b923570a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.751080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849c0b1-a3ed-4c43-a1bc-8b923570a337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.751815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849c0b1-a3ed-4c43-a1bc-8b923570a337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:55.753415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849c0b1-a3ed-4c43-a1bc-8b923570a337 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:55.766597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1165/2340] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:44:55.770751 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdcd4-0e7d-4c79-b13f-9cd25df7509c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:55.781803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdcd4-0e7d-4c79-b13f-9cd25df7509c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:55.787373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b71033-36d3-4dbf-a494-a13ed78c4a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:55.787976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b71033-36d3-4dbf-a494-a13ed78c4a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.788259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b71033-36d3-4dbf-a494-a13ed78c4a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.788563 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b71033-36d3-4dbf-a494-a13ed78c4a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.789705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b71033-36d3-4dbf-a494-a13ed78c4a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:55.791125 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b71033-36d3-4dbf-a494-a13ed78c4a62 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:55.803084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1176/2341] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:44:55.807588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849c0b1-a3ed-4c43-a1bc-8b923570a337 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:55.818065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849c0b1-a3ed-4c43-a1bc-8b923570a337 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:55.824688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:55.825588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.825912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.826236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] PATH_INFO: `/v3/projects/7994cefc64b44d1e92e94a9c8c1cca31/users/298370ea294c4150be7de29116e49d73/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.842706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7994cefc64b44d1e92e94a9c8c1cca31, user_id=298370ea294c4150be7de29116e49d73, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:55.845476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:55.916205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1166/2342] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:44:55 2022] PUT /identity/v3/projects/7994cefc64b44d1e92e94a9c8c1cca31/users/298370ea294c4150be7de29116e49d73/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:44:55.921409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d1617-ef95-4d91-ae10-1b08117a66b3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:55.921681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d1617-ef95-4d91-ae10-1b08117a66b3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:55.921968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d1617-ef95-4d91-ae10-1b08117a66b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:55.941694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e82d1617-ef95-4d91-ae10-1b08117a66b3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:44:55.943024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e82d1617-ef95-4d91-ae10-1b08117a66b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:56.020202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1177/2343] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:44:56.027807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:44:56.030768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:44:56.066152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:56.106483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10b2a1-58e7-420e-a841-bb32edd7fd24 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:44:56.111481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da4484-cc4d-4b4c-83cc-76df622ed009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:44:56.112256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da4484-cc4d-4b4c-83cc-76df622ed009 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:44:56.118756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da4484-cc4d-4b4c-83cc-76df622ed009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:44:56.118756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da4484-cc4d-4b4c-83cc-76df622ed009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:44:56.122753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da4484-cc4d-4b4c-83cc-76df622ed009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:44:56.124646 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da4484-cc4d-4b4c-83cc-76df622ed009 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:44:56.135698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1167/2344] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:45:01.361202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6c95-2568-4abd-9b4a-454f81b652c5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:01.361755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6c95-2568-4abd-9b4a-454f81b652c5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:01.361755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f6c95-2568-4abd-9b4a-454f81b652c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:01.389727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c33f6c95-2568-4abd-9b4a-454f81b652c5 None None] MFA Rules not processed for user `298370ea294c4150be7de29116e49d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:01.390981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c33f6c95-2568-4abd-9b4a-454f81b652c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:01.444252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:01.469035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1178/2345] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:45:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:45:01.473131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da4484-cc4d-4b4c-83cc-76df622ed009 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:01.483711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da4484-cc4d-4b4c-83cc-76df622ed009 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:01.488418 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac0ba-68e7-4fbf-a82d-77f504e7c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:01.489136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac0ba-68e7-4fbf-a82d-77f504e7c988 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:01.489484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac0ba-68e7-4fbf-a82d-77f504e7c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:01.489823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac0ba-68e7-4fbf-a82d-77f504e7c988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:01.490704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ac0ba-68e7-4fbf-a82d-77f504e7c988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:01.492717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ac0ba-68e7-4fbf-a82d-77f504e7c988 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:01.592271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1168/2346] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:45:01 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:45:01.596301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6c95-2568-4abd-9b4a-454f81b652c5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:01.607999 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f6c95-2568-4abd-9b4a-454f81b652c5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:01.672215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0af84-eba0-4892-8c52-2796c7def467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:01.672879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0af84-eba0-4892-8c52-2796c7def467 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:01.673150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0af84-eba0-4892-8c52-2796c7def467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:01.673418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0af84-eba0-4892-8c52-2796c7def467 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:01.674149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0af84-eba0-4892-8c52-2796c7def467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:01.676055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0af84-eba0-4892-8c52-2796c7def467 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:01.756555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1179/2347] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:45:01 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:45:01.760593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac0ba-68e7-4fbf-a82d-77f504e7c988 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:01.771965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac0ba-68e7-4fbf-a82d-77f504e7c988 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:01.776596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e0c99-2bf9-4d39-a50b-c18ffa617b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:01.777277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e0c99-2bf9-4d39-a50b-c18ffa617b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:01.778559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e0c99-2bf9-4d39-a50b-c18ffa617b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:01.778559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e0c99-2bf9-4d39-a50b-c18ffa617b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:01.778559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e0c99-2bf9-4d39-a50b-c18ffa617b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:01.781303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e0c99-2bf9-4d39-a50b-c18ffa617b49 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:01.791964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1169/2348] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:45:01.796878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0af84-eba0-4892-8c52-2796c7def467 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:01.807137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0af84-eba0-4892-8c52-2796c7def467 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:01.812505 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819ab82-0817-4263-898f-ed2b4e025403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:01.813315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819ab82-0817-4263-898f-ed2b4e025403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:01.813595 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819ab82-0817-4263-898f-ed2b4e025403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:01.813866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819ab82-0817-4263-898f-ed2b4e025403 admin admin] PATH_INFO: `/v3/projects/cb259c97ad134414a2c2c6fe00602b5a/users/56dae9ad029640369bc1eb6df53fc580/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:01.829498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819ab82-0817-4263-898f-ed2b4e025403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb259c97ad134414a2c2c6fe00602b5a, user_id=56dae9ad029640369bc1eb6df53fc580, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:01.832162 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819ab82-0817-4263-898f-ed2b4e025403 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:01.894426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1180/2349] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:45:01 2022] PUT /identity/v3/projects/cb259c97ad134414a2c2c6fe00602b5a/users/56dae9ad029640369bc1eb6df53fc580/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:45:01.898332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e0c99-2bf9-4d39-a50b-c18ffa617b49 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:01.909056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e0c99-2bf9-4d39-a50b-c18ffa617b49 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:01.965684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3ad36-2b3b-4be7-b7cc-4be7d1bbd53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:01.966923 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3ad36-2b3b-4be7-b7cc-4be7d1bbd53e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:01.967310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3ad36-2b3b-4be7-b7cc-4be7d1bbd53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:01.967591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3ad36-2b3b-4be7-b7cc-4be7d1bbd53e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:01.968315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3ad36-2b3b-4be7-b7cc-4be7d1bbd53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:01.969906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3ad36-2b3b-4be7-b7cc-4be7d1bbd53e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:01.979482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1170/2350] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:45:01.984432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819ab82-0817-4263-898f-ed2b4e025403 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:01.994950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819ab82-0817-4263-898f-ed2b4e025403 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:01.999769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:02.000673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:02.000954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:02.001226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] PATH_INFO: `/v3/projects/cb259c97ad134414a2c2c6fe00602b5a/users/56dae9ad029640369bc1eb6df53fc580/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:02.003192 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb259c97ad134414a2c2c6fe00602b5a, user_id=56dae9ad029640369bc1eb6df53fc580, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:02.005866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:02.016113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1181/2351] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:45:01 2022] PUT /identity/v3/projects/cb259c97ad134414a2c2c6fe00602b5a/users/56dae9ad029640369bc1eb6df53fc580/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:45:07.709629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5465628-11af-4fec-97ce-e7f576d9f2ee None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:07.710396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5465628-11af-4fec-97ce-e7f576d9f2ee None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:07.710396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5465628-11af-4fec-97ce-e7f576d9f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:07.740424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f5465628-11af-4fec-97ce-e7f576d9f2ee None None] MFA Rules not processed for user `56dae9ad029640369bc1eb6df53fc580`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:07.741648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f5465628-11af-4fec-97ce-e7f576d9f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:07.816649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1171/2352] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:45:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:45:07.833326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:07.835159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:07.914670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6365e-07ea-4fed-8264-2dcf068e4005 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:07.921024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4324c8a-8f05-4178-b4f0-b6021e2dee2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:07.921691 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4324c8a-8f05-4178-b4f0-b6021e2dee2b service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:07.921973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4324c8a-8f05-4178-b4f0-b6021e2dee2b service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:07.922362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4324c8a-8f05-4178-b4f0-b6021e2dee2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:07.968411 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:07.985561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4324c8a-8f05-4178-b4f0-b6021e2dee2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:07.989560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4324c8a-8f05-4178-b4f0-b6021e2dee2b service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:07.999615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1182/2353] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:45:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:45:14.346819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5465628-11af-4fec-97ce-e7f576d9f2ee None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:14.348226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f5465628-11af-4fec-97ce-e7f576d9f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:14.361288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:14.412904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5465628-11af-4fec-97ce-e7f576d9f2ee None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:14.417246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:14.418414 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:14.418885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:14.419525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] PATH_INFO: `/v3/users/40847e58131044ab9cd1166f43ca5852` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:14.420749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40847e58131044ab9cd1166f43ca5852)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:14.422736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:14.619951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40847e58131044ab9cd1166f43ca5852'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:14.699385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40847e58131044ab9cd1166f43ca5852'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:14.709900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40847e58131044ab9cd1166f43ca5852'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:14.710683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40847e58131044ab9cd1166f43ca5852'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:14.723242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40847e58131044ab9cd1166f43ca5852'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:14.729086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1172/2354] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:45:14 2022] DELETE /identity/v3/users/40847e58131044ab9cd1166f43ca5852 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:45:14.733831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a61bea-1be7-40a2-bb9e-84e88b3f0a2d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:14.734489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a61bea-1be7-40a2-bb9e-84e88b3f0a2d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:14.735239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a61bea-1be7-40a2-bb9e-84e88b3f0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:14.754129 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c5a61bea-1be7-40a2-bb9e-84e88b3f0a2d None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:14.755347 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c5a61bea-1be7-40a2-bb9e-84e88b3f0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:14.827554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1183/2355] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:45:14.837482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:14.838978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:14.901276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b914-960b-403e-b475-abd2b948d8b5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:14.906278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e51b-5d07-4800-a1c7-ce69edf84123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:14.906995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e51b-5d07-4800-a1c7-ce69edf84123 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:14.907277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e51b-5d07-4800-a1c7-ce69edf84123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:14.907627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e51b-5d07-4800-a1c7-ce69edf84123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:14.917740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e51b-5d07-4800-a1c7-ce69edf84123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:14.919241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e51b-5d07-4800-a1c7-ce69edf84123 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:14.930451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1173/2356] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:45:15.376839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a61bea-1be7-40a2-bb9e-84e88b3f0a2d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:15.378362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c5a61bea-1be7-40a2-bb9e-84e88b3f0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:15.391119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a61bea-1be7-40a2-bb9e-84e88b3f0a2d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:15.395927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:15.399482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:15.399482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:15.399482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] PATH_INFO: `/v3/projects/d2a3bb9085e244b68b849e5ca3363f34` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:15.399482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a3bb9085e244b68b849e5ca3363f34)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:15.401406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:15.510429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a3bb9085e244b68b849e5ca3363f34', 'request_id': 'req-f993ac4d-1971-46d1-ad79-0d658a55ad9b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:15.588571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a3bb9085e244b68b849e5ca3363f34', 'request_id': 'req-f993ac4d-1971-46d1-ad79-0d658a55ad9b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:15.595290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a3bb9085e244b68b849e5ca3363f34', 'request_id': 'req-f993ac4d-1971-46d1-ad79-0d658a55ad9b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:15.606738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] The token cache is being invalidate because project d2a3bb9085e244b68b849e5ca3363f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:45:15.607008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:15.607652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f993ac4d-1971-46d1-ad79-0d658a55ad9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:45:15.609857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1184/2357] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:45:15 2022] DELETE /identity/v3/projects/d2a3bb9085e244b68b849e5ca3363f34 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:45:15.614799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82987-ade1-4395-87ee-7528a8bff6d2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:15.615299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82987-ade1-4395-87ee-7528a8bff6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:15.615544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82987-ade1-4395-87ee-7528a8bff6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:15.634616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-46d82987-ade1-4395-87ee-7528a8bff6d2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:15.636352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46d82987-ade1-4395-87ee-7528a8bff6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:15.668730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:15.699672 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1174/2358] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:45:15.708415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cab51c-9f4a-45d0-9cb2-8522c267468b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:15.708703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cab51c-9f4a-45d0-9cb2-8522c267468b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:15.708980 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cab51c-9f4a-45d0-9cb2-8522c267468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:15.727730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e8cab51c-9f4a-45d0-9cb2-8522c267468b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:15.728922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e8cab51c-9f4a-45d0-9cb2-8522c267468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:15.738864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1185/2359] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:45:15.743461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d82987-ade1-4395-87ee-7528a8bff6d2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:15.754277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d82987-ade1-4395-87ee-7528a8bff6d2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:15.758803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:15.759495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:15.759998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:15.760550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:15.761558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:45:15.761863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:15.763468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:15.776559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1175/2360] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:45:15.781426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cab51c-9f4a-45d0-9cb2-8522c267468b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:15.790666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cab51c-9f4a-45d0-9cb2-8522c267468b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:15.795840 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e7153-e878-407a-8163-898a20e80d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:15.796504 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7153-e878-407a-8163-898a20e80d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:15.796784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7153-e878-407a-8163-898a20e80d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:15.797058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e7153-e878-407a-8163-898a20e80d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:15.798586 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e7153-e878-407a-8163-898a20e80d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:15.800695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e7153-e878-407a-8163-898a20e80d2c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:15.889189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1186/2361] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:45:15 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:45:15.893927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:15.904096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e1b37-0692-4cf3-8f23-0e6cdf730f43 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:15.971035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0e0d-11f3-4d06-8b26-a1678e25dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:15.972038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0e0d-11f3-4d06-8b26-a1678e25dd91 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:15.972320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0e0d-11f3-4d06-8b26-a1678e25dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:15.972594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0e0d-11f3-4d06-8b26-a1678e25dd91 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:15.973326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa0e0d-11f3-4d06-8b26-a1678e25dd91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:15.975247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa0e0d-11f3-4d06-8b26-a1678e25dd91 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:16.086786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1176/2362] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:45:15 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:45:16.090915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e7153-e878-407a-8163-898a20e80d2c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:16.101091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e7153-e878-407a-8163-898a20e80d2c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:16.105644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7876a-7fee-47d1-8157-d4ce5bb5ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:16.106320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7876a-7fee-47d1-8157-d4ce5bb5ace9 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:16.106605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7876a-7fee-47d1-8157-d4ce5bb5ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:16.106878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7876a-7fee-47d1-8157-d4ce5bb5ace9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:16.107594 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7876a-7fee-47d1-8157-d4ce5bb5ace9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:16.109185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7876a-7fee-47d1-8157-d4ce5bb5ace9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:16.119369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1187/2363] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:45:16.125816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0e0d-11f3-4d06-8b26-a1678e25dd91 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:16.135919 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0e0d-11f3-4d06-8b26-a1678e25dd91 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:16.141617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1882ad-5a7c-4b14-b22b-6528b3d7e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:16.142332 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1882ad-5a7c-4b14-b22b-6528b3d7e3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:16.142614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1882ad-5a7c-4b14-b22b-6528b3d7e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:16.142885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1882ad-5a7c-4b14-b22b-6528b3d7e3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:16.143597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1882ad-5a7c-4b14-b22b-6528b3d7e3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:16.145172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1882ad-5a7c-4b14-b22b-6528b3d7e3e8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:16.159207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1177/2364] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:45:16.163356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7876a-7fee-47d1-8157-d4ce5bb5ace9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:16.178453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7876a-7fee-47d1-8157-d4ce5bb5ace9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:16.183202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1541aa-3f80-4eed-bb22-17a9a8f91336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:16.184082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1541aa-3f80-4eed-bb22-17a9a8f91336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:16.184360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1541aa-3f80-4eed-bb22-17a9a8f91336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:16.184633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1541aa-3f80-4eed-bb22-17a9a8f91336 admin admin] PATH_INFO: `/v3/projects/0e0ec4106113454dbebe5a65cdc2f367/users/0563d87653b14887a78ec9e3ce9b0546/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:16.199926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1541aa-3f80-4eed-bb22-17a9a8f91336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0ec4106113454dbebe5a65cdc2f367, user_id=0563d87653b14887a78ec9e3ce9b0546, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:16.203241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1541aa-3f80-4eed-bb22-17a9a8f91336 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:16.293160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:16.298655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1188/2365] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:45:16 2022] PUT /identity/v3/projects/0e0ec4106113454dbebe5a65cdc2f367/users/0563d87653b14887a78ec9e3ce9b0546/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:45:16.314270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84beee-942c-48b7-a778-30ce33bab78a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:16.314514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84beee-942c-48b7-a778-30ce33bab78a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:16.314791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84beee-942c-48b7-a778-30ce33bab78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:16.343534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5f84beee-942c-48b7-a778-30ce33bab78a None None] MFA Rules not processed for user `0563d87653b14887a78ec9e3ce9b0546`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:16.344741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f84beee-942c-48b7-a778-30ce33bab78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:16.417190 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1178/2366] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:45:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:45:21.483636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6f07-5162-4fb6-a9a2-b5f232324f1c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:21.485862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6f07-5162-4fb6-a9a2-b5f232324f1c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:21.485862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6f07-5162-4fb6-a9a2-b5f232324f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:21.504895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ca4d6f07-5162-4fb6-a9a2-b5f232324f1c None None] MFA Rules not processed for user `f2b45df9a7cd466593d5c8a4f30bde53`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:21.506191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ca4d6f07-5162-4fb6-a9a2-b5f232324f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:21.563869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1189/2367] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:45:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:45:26.414513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:27.772933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84beee-942c-48b7-a778-30ce33bab78a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:27.774507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f84beee-942c-48b7-a778-30ce33bab78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:27.833623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84beee-942c-48b7-a778-30ce33bab78a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:27.837149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a2928-ad69-42a5-a1a9-994a17b8c225 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7d46c2766b4481963adefebea94c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:27.837785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2928-ad69-42a5-a1a9-994a17b8c225 service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:27.838103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2928-ad69-42a5-a1a9-994a17b8c225 service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:27.838377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2928-ad69-42a5-a1a9-994a17b8c225 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:27.846823 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a2928-ad69-42a5-a1a9-994a17b8c225 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:27.848238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a2928-ad69-42a5-a1a9-994a17b8c225 service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:27.857139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1179/2368] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:45:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:45:28.413771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d560-839d-4325-9af8-d5188c002da9 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:28.414356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d560-839d-4325-9af8-d5188c002da9 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:28.414553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153d560-839d-4325-9af8-d5188c002da9 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:28.415776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1190/2369] 10.222.0.70 () {54 vars in 912 bytes} [Wed May 18 22:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:45:28.421062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769c78-e3cc-4780-bf6a-1ca6b31ff39c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:28.421395 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769c78-e3cc-4780-bf6a-1ca6b31ff39c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:28.421659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769c78-e3cc-4780-bf6a-1ca6b31ff39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:28.440601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ec769c78-e3cc-4780-bf6a-1ca6b31ff39c None None] MFA Rules not processed for user `47783bb7d4cc41c6ac4c1adb682b093b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:28.441793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ec769c78-e3cc-4780-bf6a-1ca6b31ff39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:28.494382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1180/2370] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:45:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:45:28.510888 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d560-839d-4325-9af8-d5188c002da9 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:28.512552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4153d560-839d-4325-9af8-d5188c002da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:28.526392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153d560-839d-4325-9af8-d5188c002da9 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:28.529865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d511a-7db2-440e-b417-5f0c7ccc725e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:28.530549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d511a-7db2-440e-b417-5f0c7ccc725e service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:28.530824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d511a-7db2-440e-b417-5f0c7ccc725e service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:28.531096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d511a-7db2-440e-b417-5f0c7ccc725e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:28.538795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d511a-7db2-440e-b417-5f0c7ccc725e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:28.540200 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d511a-7db2-440e-b417-5f0c7ccc725e service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:28.566046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1191/2371] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:45:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:45:30.229138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec769c78-e3cc-4780-bf6a-1ca6b31ff39c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:45:30.230916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ec769c78-e3cc-4780-bf6a-1ca6b31ff39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:30.332714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec769c78-e3cc-4780-bf6a-1ca6b31ff39c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:45:30.337812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:45:30.338497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:30.338802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:30.339080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:30.340848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:30.352767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:45:30.354374 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:45:30.364922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1181/2372] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:45:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:45:38.544598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=31 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:40.359867 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:50.815227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf30e7-f8b8-49ec-9324-2a4e241b4fd3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:45:50.815744 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf30e7-f8b8-49ec-9324-2a4e241b4fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:45:50.815862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf30e7-f8b8-49ec-9324-2a4e241b4fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:45:50.834225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-1cbf30e7-f8b8-49ec-9324-2a4e241b4fd3 None None] MFA Rules not processed for user `298370ea294c4150be7de29116e49d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:45:50.835439 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1cbf30e7-f8b8-49ec-9324-2a4e241b4fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:45:50.889249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1192/2373] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:45:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:00.882294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=25 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:02.907466 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:02.908924 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:02.973986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114736e-f559-4d35-ab50-694e13a5987e service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:02.978509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:02.979993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:02.980270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:02.980535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] PATH_INFO: `/v3/users/8598a55eaa5d4749baabdfc4ff2bb50a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:02.981706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8598a55eaa5d4749baabdfc4ff2bb50a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:02.983627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:03.195613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8598a55eaa5d4749baabdfc4ff2bb50a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:03.268295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8598a55eaa5d4749baabdfc4ff2bb50a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:03.276374 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8598a55eaa5d4749baabdfc4ff2bb50a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:03.277024 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8598a55eaa5d4749baabdfc4ff2bb50a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:03.289129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8598a55eaa5d4749baabdfc4ff2bb50a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:03.295816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1182/2374] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:46:02 2022] DELETE /identity/v3/users/8598a55eaa5d4749baabdfc4ff2bb50a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:46:03.300306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2888-4ee7-4eb9-b4fc-741975a52646 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:03.301058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2888-4ee7-4eb9-b4fc-741975a52646 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:03.301159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2888-4ee7-4eb9-b4fc-741975a52646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:03.318778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-38ca2888-4ee7-4eb9-b4fc-741975a52646 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:03.319962 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-38ca2888-4ee7-4eb9-b4fc-741975a52646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:03.377800 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1193/2375] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:03.389505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:03.390980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:03.449468 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e874e5d-8502-4e89-a879-5bc1cf410391 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:03.453052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d2d5e-78cf-40aa-8d99-710dff6989aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:03.453691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d2d5e-78cf-40aa-8d99-710dff6989aa service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:03.453974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d2d5e-78cf-40aa-8d99-710dff6989aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:03.454285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d2d5e-78cf-40aa-8d99-710dff6989aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:03.464901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d2d5e-78cf-40aa-8d99-710dff6989aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:03.466775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d2d5e-78cf-40aa-8d99-710dff6989aa service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:03.475813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1183/2376] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:03.893419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca2888-4ee7-4eb9-b4fc-741975a52646 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:03.900083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-38ca2888-4ee7-4eb9-b4fc-741975a52646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:03.907133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca2888-4ee7-4eb9-b4fc-741975a52646 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:03.911724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:03.912728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:03.913014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:03.913287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] PATH_INFO: `/v3/projects/6cc864fdafab4ddb8dad415abb24781a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:03.914597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc864fdafab4ddb8dad415abb24781a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:03.916689 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:04.045268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc864fdafab4ddb8dad415abb24781a', 'request_id': 'req-50dcccf7-7154-4a11-be72-9c3b668e8594'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:04.114220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc864fdafab4ddb8dad415abb24781a', 'request_id': 'req-50dcccf7-7154-4a11-be72-9c3b668e8594'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:04.121498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc864fdafab4ddb8dad415abb24781a', 'request_id': 'req-50dcccf7-7154-4a11-be72-9c3b668e8594'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:04.133206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] The token cache is being invalidate because project 6cc864fdafab4ddb8dad415abb24781a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:46:04.133486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:04.134136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-50dcccf7-7154-4a11-be72-9c3b668e8594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:04.135736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1194/2377] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:46:03 2022] DELETE /identity/v3/projects/6cc864fdafab4ddb8dad415abb24781a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:46:04.141060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586cb4b-fd26-4b4b-9b58-de49e13cc11f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.141524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586cb4b-fd26-4b4b-9b58-de49e13cc11f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.141622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586cb4b-fd26-4b4b-9b58-de49e13cc11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.159549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f586cb4b-fd26-4b4b-9b58-de49e13cc11f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:04.160743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f586cb4b-fd26-4b4b-9b58-de49e13cc11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:04.178022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:04.220307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1184/2378] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:04.229683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c885a1a-18a9-4aed-bfce-b81454ee0ef5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.230063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c885a1a-18a9-4aed-bfce-b81454ee0ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.230339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c885a1a-18a9-4aed-bfce-b81454ee0ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.251282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6c885a1a-18a9-4aed-bfce-b81454ee0ef5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:04.252552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6c885a1a-18a9-4aed-bfce-b81454ee0ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:04.261092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1195/2379] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:04.265220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586cb4b-fd26-4b4b-9b58-de49e13cc11f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:04.275340 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586cb4b-fd26-4b4b-9b58-de49e13cc11f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:04.280392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:04.281050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.281333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.281611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.282372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:46:04.282682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:04.284347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:04.296788 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1185/2380] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:46:04.301733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c885a1a-18a9-4aed-bfce-b81454ee0ef5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:04.311793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c885a1a-18a9-4aed-bfce-b81454ee0ef5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:04.316410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4581-a6b6-477a-970c-fa43a10f14f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:04.317041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4581-a6b6-477a-970c-fa43a10f14f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.317318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4581-a6b6-477a-970c-fa43a10f14f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.317587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4581-a6b6-477a-970c-fa43a10f14f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.318297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d4581-a6b6-477a-970c-fa43a10f14f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:04.320216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d4581-a6b6-477a-970c-fa43a10f14f6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:04.436522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1196/2381] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:46:04 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:46:04.440396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:04.450746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a695c-c503-4598-94a8-fdd0617e297c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:04.508844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734123b-e58c-4550-a4c0-75e0d5eae3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:04.509506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734123b-e58c-4550-a4c0-75e0d5eae3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.509791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734123b-e58c-4550-a4c0-75e0d5eae3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.510978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734123b-e58c-4550-a4c0-75e0d5eae3fb admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.511422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734123b-e58c-4550-a4c0-75e0d5eae3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:04.513388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734123b-e58c-4550-a4c0-75e0d5eae3fb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:04.582118 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1186/2382] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:46:04 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:46:04.586160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4581-a6b6-477a-970c-fa43a10f14f6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:04.596296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4581-a6b6-477a-970c-fa43a10f14f6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:04.600778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0ee88-628b-4efc-be08-2195733d2902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:04.601421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0ee88-628b-4efc-be08-2195733d2902 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.601712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0ee88-628b-4efc-be08-2195733d2902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.601960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0ee88-628b-4efc-be08-2195733d2902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.602697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0ee88-628b-4efc-be08-2195733d2902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:04.604552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0ee88-628b-4efc-be08-2195733d2902 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:04.615567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1197/2383] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:46:04.619897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734123b-e58c-4550-a4c0-75e0d5eae3fb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:04.629846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734123b-e58c-4550-a4c0-75e0d5eae3fb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:04.634528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204df5-f336-4852-8976-c1a6d9f7914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:04.635984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204df5-f336-4852-8976-c1a6d9f7914f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.636426 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204df5-f336-4852-8976-c1a6d9f7914f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.636711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204df5-f336-4852-8976-c1a6d9f7914f admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.637431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204df5-f336-4852-8976-c1a6d9f7914f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:04.639044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204df5-f336-4852-8976-c1a6d9f7914f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:04.648933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1187/2384] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:46:04.653121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0ee88-628b-4efc-be08-2195733d2902 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:04.663080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0ee88-628b-4efc-be08-2195733d2902 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:04.667896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:04.668756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.669037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.669307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] PATH_INFO: `/v3/projects/f0c4bd7621c24d15a73db7e4cb5e7af0/users/5a22bb6290b446fbafcae3c323395753/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.684590 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c4bd7621c24d15a73db7e4cb5e7af0, user_id=5a22bb6290b446fbafcae3c323395753, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:04.689972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:04.743906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1198/2385] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:46:04 2022] PUT /identity/v3/projects/f0c4bd7621c24d15a73db7e4cb5e7af0/users/5a22bb6290b446fbafcae3c323395753/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:46:04.754925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15853-730d-4221-85a5-90469dbd561c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.755289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15853-730d-4221-85a5-90469dbd561c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.755639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a15853-730d-4221-85a5-90469dbd561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.785333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d5a15853-730d-4221-85a5-90469dbd561c None None] MFA Rules not processed for user `5a22bb6290b446fbafcae3c323395753`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:04.786743 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d5a15853-730d-4221-85a5-90469dbd561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:04.857950 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1188/2386] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:04.869340 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:04.872234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:04.895149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:04.939006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea73247-208a-4dd9-929e-5212f351c732 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:04.942875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74e31b-5040-4436-a91b-6bb2038f51b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:04.943674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74e31b-5040-4436-a91b-6bb2038f51b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:04.944051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74e31b-5040-4436-a91b-6bb2038f51b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:04.944417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74e31b-5040-4436-a91b-6bb2038f51b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:04.954715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74e31b-5040-4436-a91b-6bb2038f51b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:04.956284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74e31b-5040-4436-a91b-6bb2038f51b9 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:04.965246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1199/2387] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:04.990366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a15853-730d-4221-85a5-90469dbd561c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:05.009431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:05.051859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a15853-730d-4221-85a5-90469dbd561c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:05.059143 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:05.060004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:05.060282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:05.060552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] PATH_INFO: `/v3/users/5a22bb6290b446fbafcae3c323395753` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:05.061738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a22bb6290b446fbafcae3c323395753)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:05.063683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:05.207148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a22bb6290b446fbafcae3c323395753'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:05.250716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a22bb6290b446fbafcae3c323395753'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:05.257657 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a22bb6290b446fbafcae3c323395753'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:05.258307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a22bb6290b446fbafcae3c323395753'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:05.271199 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a22bb6290b446fbafcae3c323395753'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:05.277193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1189/2388] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:46:04 2022] DELETE /identity/v3/users/5a22bb6290b446fbafcae3c323395753 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:46:05.281843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ee3e-9f25-4b86-b5a8-1385a71a7e2e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:05.282166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ee3e-9f25-4b86-b5a8-1385a71a7e2e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:05.282444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79ee3e-9f25-4b86-b5a8-1385a71a7e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:05.299000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-6c79ee3e-9f25-4b86-b5a8-1385a71a7e2e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:05.300166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6c79ee3e-9f25-4b86-b5a8-1385a71a7e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:05.360540 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1200/2389] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:05.370116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:05.372296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:05.443731 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6cd98-e8f5-4733-90e2-ad24689cb01a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:05.447675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f633c72-fa90-426a-9de4-49f4987938f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:05.448651 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f633c72-fa90-426a-9de4-49f4987938f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:05.449176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f633c72-fa90-426a-9de4-49f4987938f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:05.449633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f633c72-fa90-426a-9de4-49f4987938f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:05.460377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f633c72-fa90-426a-9de4-49f4987938f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:05.461990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f633c72-fa90-426a-9de4-49f4987938f9 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:05.474504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1190/2390] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:46:05.835325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79ee3e-9f25-4b86-b5a8-1385a71a7e2e None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:05.836788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6c79ee3e-9f25-4b86-b5a8-1385a71a7e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:05.849993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79ee3e-9f25-4b86-b5a8-1385a71a7e2e None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:05.854785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:05.857205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:05.857205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:05.857205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] PATH_INFO: `/v3/projects/f0c4bd7621c24d15a73db7e4cb5e7af0` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:05.858272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c4bd7621c24d15a73db7e4cb5e7af0)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:05.860189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:05.969860 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c4bd7621c24d15a73db7e4cb5e7af0', 'request_id': 'req-b4394b58-208f-4028-9dbd-7c1b20261f9f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:06.028452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c4bd7621c24d15a73db7e4cb5e7af0', 'request_id': 'req-b4394b58-208f-4028-9dbd-7c1b20261f9f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:06.041927 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c4bd7621c24d15a73db7e4cb5e7af0', 'request_id': 'req-b4394b58-208f-4028-9dbd-7c1b20261f9f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:06.054492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] The token cache is being invalidate because project f0c4bd7621c24d15a73db7e4cb5e7af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:46:06.055030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:06.055699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b4394b58-208f-4028-9dbd-7c1b20261f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:06.057435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1201/2391] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:46:05 2022] DELETE /identity/v3/projects/f0c4bd7621c24d15a73db7e4cb5e7af0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:46:06.062817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b307-2a8d-46ab-97c0-6b2d084cc0ac None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.062817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b307-2a8d-46ab-97c0-6b2d084cc0ac None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.063064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b307-2a8d-46ab-97c0-6b2d084cc0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.081561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-99a3b307-2a8d-46ab-97c0-6b2d084cc0ac None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:06.082953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-99a3b307-2a8d-46ab-97c0-6b2d084cc0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:06.120275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:06.145846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1191/2392] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:06.154049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b7e0-2313-4976-a949-d0b40247b3da None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.154357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b7e0-2313-4976-a949-d0b40247b3da None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.154598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7b7e0-2313-4976-a949-d0b40247b3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.173827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9ff7b7e0-2313-4976-a949-d0b40247b3da None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:06.175098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9ff7b7e0-2313-4976-a949-d0b40247b3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:06.183403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1202/2393] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:06.188871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b307-2a8d-46ab-97c0-6b2d084cc0ac None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:06.199576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b307-2a8d-46ab-97c0-6b2d084cc0ac None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:06.204284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:06.204934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.205280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.205559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.206312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:46:06.206623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:06.208335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:06.221521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1192/2394] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:46:06.225738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7b7e0-2313-4976-a949-d0b40247b3da None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:06.234989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7b7e0-2313-4976-a949-d0b40247b3da None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:06.239682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb3fb9-a1c5-4d60-a97d-753048cc884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:06.240247 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb3fb9-a1c5-4d60-a97d-753048cc884c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.240523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb3fb9-a1c5-4d60-a97d-753048cc884c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.240791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb3fb9-a1c5-4d60-a97d-753048cc884c admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.241463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb3fb9-a1c5-4d60-a97d-753048cc884c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:06.243388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb3fb9-a1c5-4d60-a97d-753048cc884c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:06.327118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1203/2395] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:46:06 2022] POST /identity/v3/projects => generated 397 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:46:06.331318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:06.341594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2218b-556e-4be3-819b-3241631fdd50 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:06.397756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371ab3-5a44-46db-844d-558ec66541dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:06.398449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371ab3-5a44-46db-844d-558ec66541dc admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.398734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371ab3-5a44-46db-844d-558ec66541dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.399013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371ab3-5a44-46db-844d-558ec66541dc admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.399707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17371ab3-5a44-46db-844d-558ec66541dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:06.401619 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17371ab3-5a44-46db-844d-558ec66541dc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:06.473688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1193/2396] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:46:06 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:46:06.477769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb3fb9-a1c5-4d60-a97d-753048cc884c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:06.488676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb3fb9-a1c5-4d60-a97d-753048cc884c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:06.499859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441295-7624-478b-8988-a71d6ab82bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:06.499859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441295-7624-478b-8988-a71d6ab82bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.499859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441295-7624-478b-8988-a71d6ab82bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.499859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441295-7624-478b-8988-a71d6ab82bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.500276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35441295-7624-478b-8988-a71d6ab82bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:06.500276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35441295-7624-478b-8988-a71d6ab82bf2 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:06.507774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1204/2397] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:46:06.512270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371ab3-5a44-46db-844d-558ec66541dc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:06.522430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371ab3-5a44-46db-844d-558ec66541dc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:06.527272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497e903-fb4c-49da-9fbb-0588400f8aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:06.527926 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e903-fb4c-49da-9fbb-0588400f8aac admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.528208 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e903-fb4c-49da-9fbb-0588400f8aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.528508 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e903-fb4c-49da-9fbb-0588400f8aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.529293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497e903-fb4c-49da-9fbb-0588400f8aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:06.530944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497e903-fb4c-49da-9fbb-0588400f8aac admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:06.540720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1194/2398] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:46:06.545756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441295-7624-478b-8988-a71d6ab82bf2 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:06.556083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441295-7624-478b-8988-a71d6ab82bf2 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:06.561316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73792735-8b87-4462-a279-93423e26636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:06.562205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792735-8b87-4462-a279-93423e26636c admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.562483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792735-8b87-4462-a279-93423e26636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.562748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73792735-8b87-4462-a279-93423e26636c admin admin] PATH_INFO: `/v3/projects/aed53c1521184fedadd0bde53a7eef78/users/c269d175c6f94a6a8b1cfc1e40952603/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.564916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:06.577656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73792735-8b87-4462-a279-93423e26636c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed53c1521184fedadd0bde53a7eef78, user_id=c269d175c6f94a6a8b1cfc1e40952603, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:06.580358 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73792735-8b87-4462-a279-93423e26636c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:06.680384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1205/2399] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:46:06 2022] PUT /identity/v3/projects/aed53c1521184fedadd0bde53a7eef78/users/c269d175c6f94a6a8b1cfc1e40952603/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:46:06.692567 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ee02-09bf-4e63-8af4-eb5b16a48024 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.692959 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ee02-09bf-4e63-8af4-eb5b16a48024 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.693358 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62ee02-09bf-4e63-8af4-eb5b16a48024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.721424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9a62ee02-09bf-4e63-8af4-eb5b16a48024 None None] MFA Rules not processed for user `c269d175c6f94a6a8b1cfc1e40952603`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:06.722764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9a62ee02-09bf-4e63-8af4-eb5b16a48024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:06.792755 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1195/2400] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:46:06.804929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73792735-8b87-4462-a279-93423e26636c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:06.806699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-73792735-8b87-4462-a279-93423e26636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:06.865584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73792735-8b87-4462-a279-93423e26636c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:06.869492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65086f02-3b36-4b93-ac31-d2263395688b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:06.870205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086f02-3b36-4b93-ac31-d2263395688b service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:06.870489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086f02-3b36-4b93-ac31-d2263395688b service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:06.871341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65086f02-3b36-4b93-ac31-d2263395688b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:06.879915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65086f02-3b36-4b93-ac31-d2263395688b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:06.881339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65086f02-3b36-4b93-ac31-d2263395688b service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:06.890788 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1206/2401] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:16.789073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:16.886693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:17.931201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62ee02-09bf-4e63-8af4-eb5b16a48024 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:17.936830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9a62ee02-09bf-4e63-8af4-eb5b16a48024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:17.989939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62ee02-09bf-4e63-8af4-eb5b16a48024 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:17.993519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6c76c-b767-40fa-87e7-f67a3a57b7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:17.994216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c76c-b767-40fa-87e7-f67a3a57b7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:17.994500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c76c-b767-40fa-87e7-f67a3a57b7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:17.994775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c76c-b767-40fa-87e7-f67a3a57b7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:17.997257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8de6c76c-b767-40fa-87e7-f67a3a57b7f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:18.059470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6c76c-b767-40fa-87e7-f67a3a57b7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:18.060887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6c76c-b767-40fa-87e7-f67a3a57b7f8 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:18.070635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1196/2402] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:27.180926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65086f02-3b36-4b93-ac31-d2263395688b service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:27.243002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65086f02-3b36-4b93-ac31-d2263395688b service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:27.247606 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:27.248459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:27.248732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:27.248999 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] PATH_INFO: `/v3/users/c269d175c6f94a6a8b1cfc1e40952603` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:27.250222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c269d175c6f94a6a8b1cfc1e40952603)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:27.252133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:27.412702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c269d175c6f94a6a8b1cfc1e40952603'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:27.413267 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c269d175c6f94a6a8b1cfc1e40952603'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:27.467624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c269d175c6f94a6a8b1cfc1e40952603'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:27.479793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c269d175c6f94a6a8b1cfc1e40952603'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:27.486688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c269d175c6f94a6a8b1cfc1e40952603'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:27.492489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1207/2403] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:46:27 2022] DELETE /identity/v3/users/c269d175c6f94a6a8b1cfc1e40952603 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:46:27.497007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711555e-19a7-4be7-bf3a-e194fb805d06 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:27.497481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711555e-19a7-4be7-bf3a-e194fb805d06 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:27.497578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711555e-19a7-4be7-bf3a-e194fb805d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:27.514620 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6711555e-19a7-4be7-bf3a-e194fb805d06 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:27.515821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6711555e-19a7-4be7-bf3a-e194fb805d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:27.578447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1197/2404] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:27.584872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:27.586458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:27.644917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3fe1f-557e-4b96-831a-c2ab8eaab9bb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:27.648690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f418b13-f7d3-4ef2-a71f-b6ba8c60e35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:27.649335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f418b13-f7d3-4ef2-a71f-b6ba8c60e35d service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:27.649617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f418b13-f7d3-4ef2-a71f-b6ba8c60e35d service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:27.649893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f418b13-f7d3-4ef2-a71f-b6ba8c60e35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:27.659932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f418b13-f7d3-4ef2-a71f-b6ba8c60e35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:27.661368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f418b13-f7d3-4ef2-a71f-b6ba8c60e35d service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:27.671579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1208/2405] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:28.085818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711555e-19a7-4be7-bf3a-e194fb805d06 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:28.089010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6711555e-19a7-4be7-bf3a-e194fb805d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:28.104329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711555e-19a7-4be7-bf3a-e194fb805d06 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:28.109727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:28.110711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.110990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.111280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] PATH_INFO: `/v3/projects/aed53c1521184fedadd0bde53a7eef78` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.112580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed53c1521184fedadd0bde53a7eef78)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:28.115246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:28.238069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:28.240793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed53c1521184fedadd0bde53a7eef78', 'request_id': 'req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:28.324754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed53c1521184fedadd0bde53a7eef78', 'request_id': 'req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:28.331096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed53c1521184fedadd0bde53a7eef78', 'request_id': 'req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:28.343172 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] The token cache is being invalidate because project aed53c1521184fedadd0bde53a7eef78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:46:28.343459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:28.344197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6eadad00-32d0-4a80-aebf-c8e9ec815ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:28.345842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1198/2406] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:46:28 2022] DELETE /identity/v3/projects/aed53c1521184fedadd0bde53a7eef78 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:46:28.351739 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94c39-aa07-4055-8e17-ac6c51cb4a9f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.352202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94c39-aa07-4055-8e17-ac6c51cb4a9f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.352354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e94c39-aa07-4055-8e17-ac6c51cb4a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.370778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-23e94c39-aa07-4055-8e17-ac6c51cb4a9f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:28.372085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-23e94c39-aa07-4055-8e17-ac6c51cb4a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:28.390124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:28.432906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1209/2407] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:46:28.441622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba80f1d-3183-4805-9501-3a796aa6062c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.441911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba80f1d-3183-4805-9501-3a796aa6062c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.442221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba80f1d-3183-4805-9501-3a796aa6062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.461056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-eba80f1d-3183-4805-9501-3a796aa6062c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:28.462224 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eba80f1d-3183-4805-9501-3a796aa6062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:28.470618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1199/2408] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:28.474746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e94c39-aa07-4055-8e17-ac6c51cb4a9f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:28.484421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e94c39-aa07-4055-8e17-ac6c51cb4a9f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:28.489083 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:28.489727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.490025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.490315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.502294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:46:28.502294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:28.502294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:28.509037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1210/2409] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:46:28.510166 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba80f1d-3183-4805-9501-3a796aa6062c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:28.520464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba80f1d-3183-4805-9501-3a796aa6062c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:28.525877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9ef6-0034-49ba-9b36-2a7b5176d12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:28.525877 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9ef6-0034-49ba-9b36-2a7b5176d12e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.526206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9ef6-0034-49ba-9b36-2a7b5176d12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.526480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d9ef6-0034-49ba-9b36-2a7b5176d12e admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.527193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d9ef6-0034-49ba-9b36-2a7b5176d12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:28.529247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d9ef6-0034-49ba-9b36-2a7b5176d12e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:28.600642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1200/2410] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:46:28 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:46:28.604834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:28.615481 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5af5f-9480-4cdd-bf5f-f546bb9e7f39 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:28.673361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea947b-ec77-4901-b98a-001d105f869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:28.674076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea947b-ec77-4901-b98a-001d105f869c admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.674361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea947b-ec77-4901-b98a-001d105f869c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.674632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea947b-ec77-4901-b98a-001d105f869c admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.675583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea947b-ec77-4901-b98a-001d105f869c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:28.677495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea947b-ec77-4901-b98a-001d105f869c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:28.759002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1211/2411] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:46:28 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:46:28.763763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9ef6-0034-49ba-9b36-2a7b5176d12e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:28.774212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d9ef6-0034-49ba-9b36-2a7b5176d12e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:28.779031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113df531-b712-4b5e-849c-edd017f7fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:28.779679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113df531-b712-4b5e-849c-edd017f7fe5e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.779962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113df531-b712-4b5e-849c-edd017f7fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.780253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113df531-b712-4b5e-849c-edd017f7fe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.781039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113df531-b712-4b5e-849c-edd017f7fe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:28.782725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113df531-b712-4b5e-849c-edd017f7fe5e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:28.793670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1201/2412] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:46:28.797618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea947b-ec77-4901-b98a-001d105f869c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:28.807704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea947b-ec77-4901-b98a-001d105f869c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:28.813066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e59607-817e-4152-9910-e5cf2ec0355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:28.813712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59607-817e-4152-9910-e5cf2ec0355e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.813992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59607-817e-4152-9910-e5cf2ec0355e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.814318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e59607-817e-4152-9910-e5cf2ec0355e admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.815037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e59607-817e-4152-9910-e5cf2ec0355e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:28.816629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e59607-817e-4152-9910-e5cf2ec0355e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:28.826554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1212/2413] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:46:28.830485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113df531-b712-4b5e-849c-edd017f7fe5e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:28.840198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113df531-b712-4b5e-849c-edd017f7fe5e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:28.844740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:28.845601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.845880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.846198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] PATH_INFO: `/v3/projects/5fc1f2d036414a81ba6f2e60e8292ab6/users/d750ba769f214a88add671cf540a49cd/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.860996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc1f2d036414a81ba6f2e60e8292ab6, user_id=d750ba769f214a88add671cf540a49cd, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:28.865290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:28.971069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1202/2414] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:46:28 2022] PUT /identity/v3/projects/5fc1f2d036414a81ba6f2e60e8292ab6/users/d750ba769f214a88add671cf540a49cd/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:46:28.976042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad01d0-a7c8-448b-8dde-dd24cbd40fb8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:28.976356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad01d0-a7c8-448b-8dde-dd24cbd40fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:28.976633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad01d0-a7c8-448b-8dde-dd24cbd40fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:28.994857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-14ad01d0-a7c8-448b-8dde-dd24cbd40fb8 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:28.996623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-14ad01d0-a7c8-448b-8dde-dd24cbd40fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:29.054322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1213/2415] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:29.064730 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:29.066396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:29.123081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847037-0678-4b28-b17e-76fde65c47b7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:29.126942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d10a-dd22-4c4a-b0d7-b9b759e0eabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:29.127576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d10a-dd22-4c4a-b0d7-b9b759e0eabb service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:29.127854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d10a-dd22-4c4a-b0d7-b9b759e0eabb service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:29.128139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6d10a-dd22-4c4a-b0d7-b9b759e0eabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:29.137078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d10a-dd22-4c4a-b0d7-b9b759e0eabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:29.138532 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6d10a-dd22-4c4a-b0d7-b9b759e0eabb service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:29.147927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1203/2416] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:34.307453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676072a-7ea5-4a61-a48e-6a2843ce8aaa None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:34.308022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676072a-7ea5-4a61-a48e-6a2843ce8aaa None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:34.308022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676072a-7ea5-4a61-a48e-6a2843ce8aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:34.337091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f676072a-7ea5-4a61-a48e-6a2843ce8aaa None None] MFA Rules not processed for user `d750ba769f214a88add671cf540a49cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:34.338303 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f676072a-7ea5-4a61-a48e-6a2843ce8aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:34.357449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:34.418367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1214/2417] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:34.420829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d10a-dd22-4c4a-b0d7-b9b759e0eabb service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:34.431544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6d10a-dd22-4c4a-b0d7-b9b759e0eabb service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:34.437772 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ab9de-1953-4e9a-8cce-6aa50069e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:34.440761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ab9de-1953-4e9a-8cce-6aa50069e6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:34.440761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ab9de-1953-4e9a-8cce-6aa50069e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:34.440761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ab9de-1953-4e9a-8cce-6aa50069e6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:34.440761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ab9de-1953-4e9a-8cce-6aa50069e6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:34.441957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ab9de-1953-4e9a-8cce-6aa50069e6d2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:34.532627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1204/2418] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:46:34 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:46:34.536408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676072a-7ea5-4a61-a48e-6a2843ce8aaa None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:34.547875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676072a-7ea5-4a61-a48e-6a2843ce8aaa None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:34.637769 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117980d9-8326-4066-9048-82658c6235b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:34.638547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117980d9-8326-4066-9048-82658c6235b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:34.638929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117980d9-8326-4066-9048-82658c6235b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:34.639733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117980d9-8326-4066-9048-82658c6235b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:34.640110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117980d9-8326-4066-9048-82658c6235b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:34.642527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117980d9-8326-4066-9048-82658c6235b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:34.766373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1215/2419] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:46:34 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:46:34.770233 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ab9de-1953-4e9a-8cce-6aa50069e6d2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:34.783039 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ab9de-1953-4e9a-8cce-6aa50069e6d2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:34.788180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597b93c-8f54-43ec-8e4e-ddb743874f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:34.788854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b93c-8f54-43ec-8e4e-ddb743874f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:34.789139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b93c-8f54-43ec-8e4e-ddb743874f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:34.789416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597b93c-8f54-43ec-8e4e-ddb743874f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:34.790179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597b93c-8f54-43ec-8e4e-ddb743874f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:34.791793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597b93c-8f54-43ec-8e4e-ddb743874f86 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:34.811859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1205/2420] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:46:34.817015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117980d9-8326-4066-9048-82658c6235b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:34.828644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117980d9-8326-4066-9048-82658c6235b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:34.833610 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6724c-652f-4b26-9871-44860bd6a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:34.834633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6724c-652f-4b26-9871-44860bd6a7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:34.835626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6724c-652f-4b26-9871-44860bd6a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:34.835626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6724c-652f-4b26-9871-44860bd6a7ea admin admin] PATH_INFO: `/v3/projects/3fa4e3a617184934be48331de9c16e2a/users/d2dccab6effe447d912825d68c3366fe/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:34.851969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6724c-652f-4b26-9871-44860bd6a7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa4e3a617184934be48331de9c16e2a, user_id=d2dccab6effe447d912825d68c3366fe, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:34.855641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6724c-652f-4b26-9871-44860bd6a7ea admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:34.994922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1216/2421] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:46:34 2022] PUT /identity/v3/projects/3fa4e3a617184934be48331de9c16e2a/users/d2dccab6effe447d912825d68c3366fe/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:46:34.999231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597b93c-8f54-43ec-8e4e-ddb743874f86 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:35.009330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597b93c-8f54-43ec-8e4e-ddb743874f86 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:35.049673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:35.075216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:35.075909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:35.076257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:35.076606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:35.077409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:35.079158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:35.090752 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1206/2422] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:46:35.095006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6724c-652f-4b26-9871-44860bd6a7ea admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:35.105237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6724c-652f-4b26-9871-44860bd6a7ea admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:35.110088 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afdce7-21fb-4855-b897-d176db9d5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:35.110974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afdce7-21fb-4855-b897-d176db9d5c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:35.111254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afdce7-21fb-4855-b897-d176db9d5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:35.111531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afdce7-21fb-4855-b897-d176db9d5c7f admin admin] PATH_INFO: `/v3/projects/3fa4e3a617184934be48331de9c16e2a/users/d2dccab6effe447d912825d68c3366fe/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:35.113617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afdce7-21fb-4855-b897-d176db9d5c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa4e3a617184934be48331de9c16e2a, user_id=d2dccab6effe447d912825d68c3366fe, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:35.116277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afdce7-21fb-4855-b897-d176db9d5c7f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:35.127141 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1217/2423] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:46:35 2022] PUT /identity/v3/projects/3fa4e3a617184934be48331de9c16e2a/users/d2dccab6effe447d912825d68c3366fe/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:46:39.891958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:39.894491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:39.907555 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed16728-5d75-4be8-b24f-764845d9c999 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:39.968824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:39.969804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:39.970465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:39.970835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] PATH_INFO: `/v3/users/0563d87653b14887a78ec9e3ce9b0546` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:39.972506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0563d87653b14887a78ec9e3ce9b0546)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:39.974639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:40.179910 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0563d87653b14887a78ec9e3ce9b0546'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:40.278342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0563d87653b14887a78ec9e3ce9b0546'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:40.286296 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0563d87653b14887a78ec9e3ce9b0546'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:40.287038 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0563d87653b14887a78ec9e3ce9b0546'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:40.302490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0563d87653b14887a78ec9e3ce9b0546'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:40.310273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1207/2424] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:46:39 2022] DELETE /identity/v3/users/0563d87653b14887a78ec9e3ce9b0546 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:46:40.314422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a6136-6cc8-422b-bf4f-39254639bc46 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:40.314883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a6136-6cc8-422b-bf4f-39254639bc46 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:40.314994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a6136-6cc8-422b-bf4f-39254639bc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:40.336940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-870a6136-6cc8-422b-bf4f-39254639bc46 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:40.338161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-870a6136-6cc8-422b-bf4f-39254639bc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:40.454640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1218/2425] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:40.463995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:40.465705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:40.630652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332efcf-7a59-4e05-92a1-e9ef342fe0e7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:40.635400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:40.636475 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:40.636953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:40.637455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:40.649243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523738dc-ca2a-4134-a8af-8f4cc8bf0bca None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:40.649878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523738dc-ca2a-4134-a8af-8f4cc8bf0bca None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:40.650173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523738dc-ca2a-4134-a8af-8f4cc8bf0bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:40.663367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:40.664825 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:40.670393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:40.675882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:40.677425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1208/2426] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:40.685037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-523738dc-ca2a-4134-a8af-8f4cc8bf0bca None None] MFA Rules not processed for user `d2dccab6effe447d912825d68c3366fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:40.686475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-523738dc-ca2a-4134-a8af-8f4cc8bf0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:40.799119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1219/2427] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:40 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:40.816099 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:40.818973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:40.894580 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406cc63-f616-444b-aeb3-6f54c867b22b service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:40.900382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414359c1-14ed-4560-aca3-bed52b2b014b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:40.901128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414359c1-14ed-4560-aca3-bed52b2b014b service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:40.901410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414359c1-14ed-4560-aca3-bed52b2b014b service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:40.901682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414359c1-14ed-4560-aca3-bed52b2b014b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:40.904245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-414359c1-14ed-4560-aca3-bed52b2b014b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:40.985336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414359c1-14ed-4560-aca3-bed52b2b014b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:40.987022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414359c1-14ed-4560-aca3-bed52b2b014b service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:40.997837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1209/2428] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:41.219473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523738dc-ca2a-4134-a8af-8f4cc8bf0bca None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:41.220725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-523738dc-ca2a-4134-a8af-8f4cc8bf0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:41.240564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523738dc-ca2a-4134-a8af-8f4cc8bf0bca None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:41.246429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:41.252475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:41.252475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:41.252475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] PATH_INFO: `/v3/projects/0e0ec4106113454dbebe5a65cdc2f367` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:41.252475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0ec4106113454dbebe5a65cdc2f367)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:41.252475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:41.378784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0ec4106113454dbebe5a65cdc2f367', 'request_id': 'req-cb4d6917-0cc3-4230-b4ca-9bad73241046'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:41.457096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0ec4106113454dbebe5a65cdc2f367', 'request_id': 'req-cb4d6917-0cc3-4230-b4ca-9bad73241046'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:41.459035 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0ec4106113454dbebe5a65cdc2f367', 'request_id': 'req-cb4d6917-0cc3-4230-b4ca-9bad73241046'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:41.471252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] The token cache is being invalidate because project 0e0ec4106113454dbebe5a65cdc2f367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:46:41.471537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:41.472220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:46:41.473754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1220/2429] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:46:41 2022] DELETE /identity/v3/projects/0e0ec4106113454dbebe5a65cdc2f367 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:46:43.723508 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ac24-a4af-47ac-b1a5-cf1549d1ff0a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:43.724007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ac24-a4af-47ac-b1a5-cf1549d1ff0a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:43.724263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ac24-a4af-47ac-b1a5-cf1549d1ff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:43.742673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3fa4ac24-a4af-47ac-b1a5-cf1549d1ff0a None None] MFA Rules not processed for user `d750ba769f214a88add671cf540a49cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:46:43.743816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3fa4ac24-a4af-47ac-b1a5-cf1549d1ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:43.813331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1210/2430] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:46:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:46:51.468655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:53.422690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:53.424222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:53.484430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d6917-0cc3-4230-b4ca-9bad73241046 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:53.488677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7d46c2766b4481963adefebea94c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:53.489319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:53.489600 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:53.489870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:53.491663 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:53.565000 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:53.566488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:53.577794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1221/2431] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:46:53.804588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=82 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:53.914561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ac24-a4af-47ac-b1a5-cf1549d1ff0a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:46:53.915949 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3fa4ac24-a4af-47ac-b1a5-cf1549d1ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:53.978903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ac24-a4af-47ac-b1a5-cf1549d1ff0a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:46:53.982517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:46:53.983157 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:46:53.983435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:46:53.983707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:46:53.986037 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:46:54.001655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:46:54.003134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:46:54.014984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1211/2432] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:46:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:47:03.572744 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=54 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:04.009801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=26 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:09.742248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:09.747044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:09.758346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229714b0-0f33-480b-bec9-3ef9b414a22e service glance] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:09.764212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:09.765048 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:09.765771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:09.766238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:09.768030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:09.828320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:09.830158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:09.840398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1222/2433] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:10.055504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:10.064912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812757c-4b3d-4ea0-83b2-3498b07e996d service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:10.068538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:10.069163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:10.069467 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:10.069737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:10.071491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:10.081989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:10.083415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:10.091597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1212/2434] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:10.775837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:10.777494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:10.854830 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68138a4-a128-437c-b13b-e4711a108249 service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:10.860447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:10.861082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:10.861359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:10.861633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:10.863587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:10.874936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:10.876676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:10.886887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1223/2435] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:14.135501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:14.145060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4f7b5-e6f6-4369-9963-1dbe067b5cc1 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:14.148801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338e7b6-d4ab-4a9c-9bf9-36e9561b6854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:14.149436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338e7b6-d4ab-4a9c-9bf9-36e9561b6854 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:14.153840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338e7b6-d4ab-4a9c-9bf9-36e9561b6854 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:14.153840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338e7b6-d4ab-4a9c-9bf9-36e9561b6854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:14.155750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3338e7b6-d4ab-4a9c-9bf9-36e9561b6854 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:14.165985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338e7b6-d4ab-4a9c-9bf9-36e9561b6854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:14.167439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338e7b6-d4ab-4a9c-9bf9-36e9561b6854 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:14.177342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1213/2436] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:15.052173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:15.076338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae583ae-b5ba-4337-9193-4499f7ff48e8 service placement] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:15.091801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:15.091801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:15.091801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:15.091801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:15.092224 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:15.102330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:15.103983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:15.117551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1224/2437] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:15.560954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca19a-e3ea-44d4-bfee-43a4bb673137 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:15.561461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca19a-e3ea-44d4-bfee-43a4bb673137 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:15.561461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca19a-e3ea-44d4-bfee-43a4bb673137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:15.580964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c5eca19a-e3ea-44d4-bfee-43a4bb673137 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:47:15.582293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c5eca19a-e3ea-44d4-bfee-43a4bb673137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:15.648766 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1214/2438] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:47:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:47:15.768082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:15.769470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:15.839819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25868bfc-4e35-4699-aa6e-c082e885bacf service nova] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:15.845682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d9003-5e9a-408e-8fe9-34458c6d8e4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:15.850781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d9003-5e9a-408e-8fe9-34458c6d8e4e service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:15.850781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d9003-5e9a-408e-8fe9-34458c6d8e4e service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:15.850781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d9003-5e9a-408e-8fe9-34458c6d8e4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:15.856045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d9003-5e9a-408e-8fe9-34458c6d8e4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:15.857631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d9003-5e9a-408e-8fe9-34458c6d8e4e service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:15.866589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1225/2439] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:47:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 22:47:25.641790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=37 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:25.863828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:32.307274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eca19a-e3ea-44d4-bfee-43a4bb673137 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:32.320544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eca19a-e3ea-44d4-bfee-43a4bb673137 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:32.326128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b93c41-6c98-41ac-922b-f4fe180d0d0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:32.326765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93c41-6c98-41ac-922b-f4fe180d0d0f service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:32.327051 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93c41-6c98-41ac-922b-f4fe180d0d0f service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:32.327328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b93c41-6c98-41ac-922b-f4fe180d0d0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:32.329231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-30b93c41-6c98-41ac-922b-f4fe180d0d0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:32.342749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b93c41-6c98-41ac-922b-f4fe180d0d0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:32.344318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b93c41-6c98-41ac-922b-f4fe180d0d0f service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:32.355842 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1215/2440] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:35.223713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51657-1ce2-4f38-8780-601f8f0b4c8f None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.224342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51657-1ce2-4f38-8780-601f8f0b4c8f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.224342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51657-1ce2-4f38-8780-601f8f0b4c8f None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.227249 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1226/2441] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:47:35.232519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edebf45-a137-4ba6-b694-792f77b23e11 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.233079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edebf45-a137-4ba6-b694-792f77b23e11 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.234207 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edebf45-a137-4ba6-b694-792f77b23e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.285796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4edebf45-a137-4ba6-b694-792f77b23e11 None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:47:35.287802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4edebf45-a137-4ba6-b694-792f77b23e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:35.298968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1216/2442] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:47:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:47:35.313416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51657-1ce2-4f38-8780-601f8f0b4c8f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:35.325776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51657-1ce2-4f38-8780-601f8f0b4c8f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:35.329576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3c079-a78e-4c3e-8f2c-10d57455d740 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7d46c2766b4481963adefebea94c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:35.332726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c079-a78e-4c3e-8f2c-10d57455d740 service glance] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.332726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c079-a78e-4c3e-8f2c-10d57455d740 service glance] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.332726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c079-a78e-4c3e-8f2c-10d57455d740 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.343386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3c079-a78e-4c3e-8f2c-10d57455d740 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:35.344881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3c079-a78e-4c3e-8f2c-10d57455d740 service glance] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:35.359460 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1227/2443] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:35.570984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1145-7f6f-44d5-a10f-1c071e350111 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.571330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1145-7f6f-44d5-a10f-1c071e350111 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.571808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1145-7f6f-44d5-a10f-1c071e350111 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.573246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1217/2444] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:47:35.578495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b48c7-6ebd-4ad3-9ead-1fe006e1b1d4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.578776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b48c7-6ebd-4ad3-9ead-1fe006e1b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.579048 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b48c7-6ebd-4ad3-9ead-1fe006e1b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.598084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-355b48c7-6ebd-4ad3-9ead-1fe006e1b1d4 None None] MFA Rules not processed for user `47783bb7d4cc41c6ac4c1adb682b093b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:47:35.599142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-355b48c7-6ebd-4ad3-9ead-1fe006e1b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:35.605604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1228/2445] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:47:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:47:35.618113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c1145-7f6f-44d5-a10f-1c071e350111 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:35.619805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-428c1145-7f6f-44d5-a10f-1c071e350111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:35.635879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c1145-7f6f-44d5-a10f-1c071e350111 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:35.639593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466dac3-6dff-4ab9-9fca-d4f47dfd7c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:35.640226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466dac3-6dff-4ab9-9fca-d4f47dfd7c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.640557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466dac3-6dff-4ab9-9fca-d4f47dfd7c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.640835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466dac3-6dff-4ab9-9fca-d4f47dfd7c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.648349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466dac3-6dff-4ab9-9fca-d4f47dfd7c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:35.649780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466dac3-6dff-4ab9-9fca-d4f47dfd7c36 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:35.657653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1218/2446] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:35.745291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6801-7cf0-409b-b902-e23bbcedabd1 None None] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.745702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6801-7cf0-409b-b902-e23bbcedabd1 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.746036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae6801-7cf0-409b-b902-e23bbcedabd1 None None] PATH_INFO: `/` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.747843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1229/2447] 10.222.0.70 () {54 vars in 921 bytes} [Wed May 18 22:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 22:47:35.754459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca6e9-46b7-4f0a-8060-920f7f23029b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.754754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca6e9-46b7-4f0a-8060-920f7f23029b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.755032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca6e9-46b7-4f0a-8060-920f7f23029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.774626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c3dca6e9-46b7-4f0a-8060-920f7f23029b None None] MFA Rules not processed for user `55b3fcbfb08544d482bd0bea4b3d3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:47:35.775625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c3dca6e9-46b7-4f0a-8060-920f7f23029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:35.785954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1219/2448] 10.222.0.70 () {58 vars in 1018 bytes} [Wed May 18 22:47:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:47:35.797641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6801-7cf0-409b-b902-e23bbcedabd1 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:35.811326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae6801-7cf0-409b-b902-e23bbcedabd1 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:35.815698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955657a-9147-4e3b-9b62-5b56128aa2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:35.817305 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955657a-9147-4e3b-9b62-5b56128aa2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.817674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955657a-9147-4e3b-9b62-5b56128aa2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.818145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955657a-9147-4e3b-9b62-5b56128aa2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.829750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955657a-9147-4e3b-9b62-5b56128aa2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:35.831234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955657a-9147-4e3b-9b62-5b56128aa2a7 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:35.842982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1230/2449] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:35.979581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca6e9-46b7-4f0a-8060-920f7f23029b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:35.989401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca6e9-46b7-4f0a-8060-920f7f23029b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:35.993033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171477cb-9c69-4656-b90d-ff97768372a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:35.993673 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171477cb-9c69-4656-b90d-ff97768372a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:35.993955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171477cb-9c69-4656-b90d-ff97768372a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:35.994269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171477cb-9c69-4656-b90d-ff97768372a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:35.996083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-171477cb-9c69-4656-b90d-ff97768372a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:36.063931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171477cb-9c69-4656-b90d-ff97768372a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:36.065457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171477cb-9c69-4656-b90d-ff97768372a4 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:36.076270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1220/2450] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:42.465420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6566-ac6e-4a55-becc-f719edabd51d None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:42.465977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6566-ac6e-4a55-becc-f719edabd51d None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:42.466119 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b6566-ac6e-4a55-becc-f719edabd51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:42.484979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-086b6566-ac6e-4a55-becc-f719edabd51d None None] MFA Rules not processed for user `be51e8b84bb7471bb17409b331e599eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:47:42.486511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-086b6566-ac6e-4a55-becc-f719edabd51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:42.493841 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1231/2451] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:47:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:47:43.167463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62204-66d7-43f6-b988-4ee7da48e782 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:43.167980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62204-66d7-43f6-b988-4ee7da48e782 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:43.168100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b62204-66d7-43f6-b988-4ee7da48e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:43.185813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f0b62204-66d7-43f6-b988-4ee7da48e782 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:47:43.187055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f0b62204-66d7-43f6-b988-4ee7da48e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:43.195020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1221/2452] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:47:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:47:43.208339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b6566-ac6e-4a55-becc-f719edabd51d None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:43.221168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b6566-ac6e-4a55-becc-f719edabd51d None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:43.226384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a55e0-1f37-42e6-ad31-aa132b68de95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:43.227298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a55e0-1f37-42e6-ad31-aa132b68de95 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:43.227638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a55e0-1f37-42e6-ad31-aa132b68de95 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:43.227975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a55e0-1f37-42e6-ad31-aa132b68de95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:43.237379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a55e0-1f37-42e6-ad31-aa132b68de95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:43.239764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a55e0-1f37-42e6-ad31-aa132b68de95 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:43.248384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1232/2453] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:47:47.519285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62204-66d7-43f6-b988-4ee7da48e782 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:47:47.532622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b62204-66d7-43f6-b988-4ee7da48e782 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:47:47.540046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:47:47.540780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:47:47.541375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:47:47.542192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:47:47.545933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:47:47.634246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:47:47.635874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:47:47.646638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1222/2454] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:47:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:47:53.245833 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=24 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:57.641144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:12.975116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90926c46-d9b8-4d86-9970-de5761d9454e None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:48:12.975708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90926c46-d9b8-4d86-9970-de5761d9454e None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:48:12.975708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90926c46-d9b8-4d86-9970-de5761d9454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:48:12.994581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-90926c46-d9b8-4d86-9970-de5761d9454e None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:48:12.995787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-90926c46-d9b8-4d86-9970-de5761d9454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:48:13.003531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1233/2455] 10.222.0.70 () {58 vars in 967 bytes} [Wed May 18 22:48:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:48:13.016683 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:48:13.028835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4b66f-d9d2-4195-bd7a-bf7ed7922064 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:48:13.035152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:48:13.035781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:48:13.036156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:48:13.036440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:48:13.046223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:48:13.047801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:48:13.057106 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1223/2456] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:48:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 22:48:19.844078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc6963-7c70-4731-9397-0b5c742c1b94 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:48:19.844623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc6963-7c70-4731-9397-0b5c742c1b94 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:48:19.844623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc6963-7c70-4731-9397-0b5c742c1b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:48:19.863568 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b2bc6963-7c70-4731-9397-0b5c742c1b94 None None] MFA Rules not processed for user `f2b45df9a7cd466593d5c8a4f30bde53`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:48:19.864756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b2bc6963-7c70-4731-9397-0b5c742c1b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:48:19.871733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1234/2457] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:48:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:48:23.053630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:29.857900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=6 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:34.784970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:48:34.786965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:48:34.803395 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7abd3-d3f9-4106-b8a2-f1405661f6bc service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:48:34.808716 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:48:34.809351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:48:34.809629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:48:34.809897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:48:34.811678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:48:34.824128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:48:34.825599 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:48:34.836405 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1224/2458] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:48:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:48:44.831665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:04.503566 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc748c-294b-43d3-888e-8dd886231cb4 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:04.504065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc748c-294b-43d3-888e-8dd886231cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:04.504170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc748c-294b-43d3-888e-8dd886231cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:04.522253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-4cfc748c-294b-43d3-888e-8dd886231cb4 None None] MFA Rules not processed for user `298370ea294c4150be7de29116e49d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:49:04.524107 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4cfc748c-294b-43d3-888e-8dd886231cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:04.577353 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1235/2459] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:49:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:49:14.570658 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=25 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:21.998591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:22.011291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2964d4f-5b25-4e82-8ccd-a903faa20fc4 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:22.016968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6bb8-e437-4609-a28f-c3f02bec28b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:22.017618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6bb8-e437-4609-a28f-c3f02bec28b9 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:22.017903 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6bb8-e437-4609-a28f-c3f02bec28b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:22.018384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6bb8-e437-4609-a28f-c3f02bec28b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:22.020158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-aaae6bb8-e437-4609-a28f-c3f02bec28b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:22.088758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae6bb8-e437-4609-a28f-c3f02bec28b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:22.090419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae6bb8-e437-4609-a28f-c3f02bec28b9 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:22.099669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1225/2460] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:49:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:49:32.095488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=28 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:32.486677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc748c-294b-43d3-888e-8dd886231cb4 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:32.496771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc748c-294b-43d3-888e-8dd886231cb4 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:32.500306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:32.505047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:32.505047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:32.505047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:32.505047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:32.571044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:32.573050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:32.584265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1236/2461] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:49:33.201132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810d05-729d-4c18-ab98-b824185d7cec None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:33.205016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810d05-729d-4c18-ab98-b824185d7cec None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:33.205016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810d05-729d-4c18-ab98-b824185d7cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:33.220072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-87810d05-729d-4c18-ab98-b824185d7cec None None] MFA Rules not processed for user `2ffacb9e00b8448eb56a233a5d564d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:49:33.221278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-87810d05-729d-4c18-ab98-b824185d7cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:33.228936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1226/2462] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:49:36.769031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:36.770583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:36.783300 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7025706-48e7-4e78-ba45-8244bd074eeb service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:36.787805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:36.788757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:36.789040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:36.789313 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] PATH_INFO: `/v3/users/be51e8b84bb7471bb17409b331e599eb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:36.791146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be51e8b84bb7471bb17409b331e599eb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:36.793226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:37.004492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be51e8b84bb7471bb17409b331e599eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.005142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be51e8b84bb7471bb17409b331e599eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.092277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be51e8b84bb7471bb17409b331e599eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.108756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be51e8b84bb7471bb17409b331e599eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.116492 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-0f96c79e-dd53-4a44-8d6f-e3297d1c8601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be51e8b84bb7471bb17409b331e599eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.125789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1237/2463] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:49:36 2022] DELETE /identity/v3/users/be51e8b84bb7471bb17409b331e599eb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:49:37.418653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810d05-729d-4c18-ab98-b824185d7cec None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:37.432413 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810d05-729d-4c18-ab98-b824185d7cec None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:37.496916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:37.498423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:37.498423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:37.498423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] PATH_INFO: `/v3/projects/c184ebb6e93a4cd58d65d8fbe43c4760` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:37.499524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c184ebb6e93a4cd58d65d8fbe43c4760)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:37.501427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:37.612688 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'request_id': 'req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.690613 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'request_id': 'req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.697898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'request_id': 'req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.710615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] The token cache is being invalidate because project c184ebb6e93a4cd58d65d8fbe43c4760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:49:37.710749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.711509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ee9b95ca-20a5-4e68-9db7-6cb39dab34bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:49:37.713610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1227/2464] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:49:37 2022] DELETE /identity/v3/projects/c184ebb6e93a4cd58d65d8fbe43c4760 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:49:37.720673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babba7-e7f2-4ad7-a356-f4f30e33cc1a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:37.721122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babba7-e7f2-4ad7-a356-f4f30e33cc1a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:37.721542 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09babba7-e7f2-4ad7-a356-f4f30e33cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:37.746618 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-09babba7-e7f2-4ad7-a356-f4f30e33cc1a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:49:37.747823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-09babba7-e7f2-4ad7-a356-f4f30e33cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:37.829922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1238/2465] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:49:37.832675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab62c6-9960-4d43-ae39-bbe2b9add589 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:37.833027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab62c6-9960-4d43-ae39-bbe2b9add589 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:37.833631 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab62c6-9960-4d43-ae39-bbe2b9add589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:37.858736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9ab62c6-9960-4d43-ae39-bbe2b9add589 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:49:37.859968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9ab62c6-9960-4d43-ae39-bbe2b9add589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:37.872439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1228/2466] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:49:37.876835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09babba7-e7f2-4ad7-a356-f4f30e33cc1a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:37.888681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09babba7-e7f2-4ad7-a356-f4f30e33cc1a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:37.894456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:37.895662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:37.896319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:37.896766 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:37.897748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:49:37.898227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:37.902648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:37.904819 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:37.921511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1239/2467] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:49:37.922976 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab62c6-9960-4d43-ae39-bbe2b9add589 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:37.935013 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab62c6-9960-4d43-ae39-bbe2b9add589 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:37.940809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b006c6-2bda-4d4a-b218-685f3e66d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:37.941648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b006c6-2bda-4d4a-b218-685f3e66d6cc admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:37.942119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b006c6-2bda-4d4a-b218-685f3e66d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:37.943600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b006c6-2bda-4d4a-b218-685f3e66d6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:37.943600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b006c6-2bda-4d4a-b218-685f3e66d6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:37.945662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b006c6-2bda-4d4a-b218-685f3e66d6cc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:38.064853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1229/2468] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:49:37 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:49:38.070741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:38.082748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62e08-739b-4296-9f7e-18bd4f4d24bd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:38.142086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d0769-daab-40ad-a5b5-232163dd020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:38.142845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0769-daab-40ad-a5b5-232163dd020f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:38.143116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0769-daab-40ad-a5b5-232163dd020f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:38.143391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0769-daab-40ad-a5b5-232163dd020f admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:38.144080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d0769-daab-40ad-a5b5-232163dd020f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:38.145997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d0769-daab-40ad-a5b5-232163dd020f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:38.206573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1240/2469] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:49:38 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:49:38.210662 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b006c6-2bda-4d4a-b218-685f3e66d6cc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:38.221807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b006c6-2bda-4d4a-b218-685f3e66d6cc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:38.226464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec921a0-d327-44f9-8487-fc7a28f004ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:38.227134 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec921a0-d327-44f9-8487-fc7a28f004ba admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:38.227417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec921a0-d327-44f9-8487-fc7a28f004ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:38.227698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec921a0-d327-44f9-8487-fc7a28f004ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:38.231436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec921a0-d327-44f9-8487-fc7a28f004ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:38.231436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec921a0-d327-44f9-8487-fc7a28f004ba admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:38.240661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1230/2470] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:49:38.245206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d0769-daab-40ad-a5b5-232163dd020f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:38.255718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d0769-daab-40ad-a5b5-232163dd020f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:38.268982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1e3f4-7bf0-4678-b081-178062519027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:38.268982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1e3f4-7bf0-4678-b081-178062519027 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:38.268982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1e3f4-7bf0-4678-b081-178062519027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:38.268982 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1e3f4-7bf0-4678-b081-178062519027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:38.269485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1e3f4-7bf0-4678-b081-178062519027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:38.269485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1e3f4-7bf0-4678-b081-178062519027 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:38.280089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1241/2471] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:49:38.281258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec921a0-d327-44f9-8487-fc7a28f004ba admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:38.292328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec921a0-d327-44f9-8487-fc7a28f004ba admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:38.297386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:38.298317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:38.298598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:38.298872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] PATH_INFO: `/v3/projects/89ab9bb65d8a44348faf97c7d19d8c84/users/18d0bc67048c4bbb893f2589800c4535/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:38.315892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ab9bb65d8a44348faf97c7d19d8c84, user_id=18d0bc67048c4bbb893f2589800c4535, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:38.318648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:38.368306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1231/2472] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:49:38 2022] PUT /identity/v3/projects/89ab9bb65d8a44348faf97c7d19d8c84/users/18d0bc67048c4bbb893f2589800c4535/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:49:38.373242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c643c-8c95-4abe-b8fd-ef00f2f7aa89 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:38.378911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c643c-8c95-4abe-b8fd-ef00f2f7aa89 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:38.378911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c643c-8c95-4abe-b8fd-ef00f2f7aa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:38.393175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a13c643c-8c95-4abe-b8fd-ef00f2f7aa89 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:49:38.396149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a13c643c-8c95-4abe-b8fd-ef00f2f7aa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:38.459270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1242/2473] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:49:38.469759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:38.471576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:38.486059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:38.530415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa53c-86fb-4355-8987-b48f3f5c6fb5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:38.534031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:38.534671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:38.535107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:38.535226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:38.545047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:38.546897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:38.557461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1232/2474] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:49:44.074961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e5df6-49dd-4ae2-922b-8b54eb245290 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:44.075478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e5df6-49dd-4ae2-922b-8b54eb245290 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:44.075703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e5df6-49dd-4ae2-922b-8b54eb245290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:44.104989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c63e5df6-49dd-4ae2-922b-8b54eb245290 None None] MFA Rules not processed for user `18d0bc67048c4bbb893f2589800c4535`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:49:44.106258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c63e5df6-49dd-4ae2-922b-8b54eb245290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:44.173288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1243/2475] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:49:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:49:44.187173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:49:44.188647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:44.281098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6c29a-6ab5-4f48-bc9f-eda8b635c208 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:49:44.287081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b561be9-81e6-40da-8eae-11943100fbf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:49:44.287738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b561be9-81e6-40da-8eae-11943100fbf7 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:44.288016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b561be9-81e6-40da-8eae-11943100fbf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:44.288288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b561be9-81e6-40da-8eae-11943100fbf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:44.298057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b561be9-81e6-40da-8eae-11943100fbf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:49:44.299682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b561be9-81e6-40da-8eae-11943100fbf7 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:49:44.311249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1233/2476] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:49:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:49:46.757092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408375b0-e818-4b74-b0fa-0108934e685c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:49:46.758131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408375b0-e818-4b74-b0fa-0108934e685c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:49:46.758483 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408375b0-e818-4b74-b0fa-0108934e685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:49:46.765507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:46.780037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-408375b0-e818-4b74-b0fa-0108934e685c None None] MFA Rules not processed for user `18d0bc67048c4bbb893f2589800c4535`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:49:46.781753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-408375b0-e818-4b74-b0fa-0108934e685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:49:46.789412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1244/2477] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:49:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:49:54.306280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=55 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:56.885718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:15.282019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6b82-5cf2-4973-9985-fcaf2b5e0292 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:50:15.282550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6b82-5cf2-4973-9985-fcaf2b5e0292 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:50:15.282661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb6b82-5cf2-4973-9985-fcaf2b5e0292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:50:15.300577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bebb6b82-5cf2-4973-9985-fcaf2b5e0292 None None] MFA Rules not processed for user `f2b45df9a7cd466593d5c8a4f30bde53`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:50:15.301804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bebb6b82-5cf2-4973-9985-fcaf2b5e0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:50:15.357022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1234/2478] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:50:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:50:25.349611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=25 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:39.034331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408375b0-e818-4b74-b0fa-0108934e685c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:50:39.035857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-408375b0-e818-4b74-b0fa-0108934e685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:50:39.114868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408375b0-e818-4b74-b0fa-0108934e685c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:50:39.119921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6af5a-b427-461b-8ff9-388846be4b8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:50:39.120561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6af5a-b427-461b-8ff9-388846be4b8b service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:50:39.120839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6af5a-b427-461b-8ff9-388846be4b8b service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:50:39.121108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6af5a-b427-461b-8ff9-388846be4b8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:50:39.123534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d9b6af5a-b427-461b-8ff9-388846be4b8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:50:39.134894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6af5a-b427-461b-8ff9-388846be4b8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:50:39.136400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6af5a-b427-461b-8ff9-388846be4b8b service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:50:39.146990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1245/2479] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:50:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:50:49.142623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=32 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:29.872449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb6b82-5cf2-4973-9985-fcaf2b5e0292 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:51:29.879229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bebb6b82-5cf2-4973-9985-fcaf2b5e0292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:51:29.930433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb6b82-5cf2-4973-9985-fcaf2b5e0292 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:51:29.933940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd8ff7-1b0f-4170-88df-348aa7800e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:51:29.934603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8ff7-1b0f-4170-88df-348aa7800e66 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:51:29.934879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8ff7-1b0f-4170-88df-348aa7800e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:51:29.935148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8ff7-1b0f-4170-88df-348aa7800e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:51:29.936875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b6cd8ff7-1b0f-4170-88df-348aa7800e66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:51:29.994636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd8ff7-1b0f-4170-88df-348aa7800e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:51:29.996057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd8ff7-1b0f-4170-88df-348aa7800e66 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:51:30.005636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1235/2480] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:51:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:51:40.000963 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=48 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:44.608254 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42205f-fba7-4c35-a74a-72c413403759 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:51:44.608770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42205f-fba7-4c35-a74a-72c413403759 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:51:44.608878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42205f-fba7-4c35-a74a-72c413403759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:51:44.626612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-be42205f-fba7-4c35-a74a-72c413403759 None None] MFA Rules not processed for user `298370ea294c4150be7de29116e49d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:51:44.630699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-be42205f-fba7-4c35-a74a-72c413403759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:51:44.634708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1246/2481] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:51:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:51:46.179078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46193cc3-4eb1-4320-b537-486cbe46d19f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:51:46.179746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46193cc3-4eb1-4320-b537-486cbe46d19f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:51:46.180193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46193cc3-4eb1-4320-b537-486cbe46d19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:51:46.197762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-46193cc3-4eb1-4320-b537-486cbe46d19f None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:51:46.198985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46193cc3-4eb1-4320-b537-486cbe46d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:51:46.261560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1236/2482] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:51:46.426282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42205f-fba7-4c35-a74a-72c413403759 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:51:46.427756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-be42205f-fba7-4c35-a74a-72c413403759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:51:46.500130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42205f-fba7-4c35-a74a-72c413403759 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:51:46.505963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4a2e8-2f65-4e11-b100-f75cfdbf76f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:51:46.513622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4a2e8-2f65-4e11-b100-f75cfdbf76f7 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:51:46.513622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4a2e8-2f65-4e11-b100-f75cfdbf76f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:51:46.513622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4a2e8-2f65-4e11-b100-f75cfdbf76f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:51:46.515620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4a2e8-2f65-4e11-b100-f75cfdbf76f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:51:46.517236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4a2e8-2f65-4e11-b100-f75cfdbf76f7 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:51:46.526263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1247/2483] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:51:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:51:53.213767 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46193cc3-4eb1-4320-b537-486cbe46d19f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:51:53.223782 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46193cc3-4eb1-4320-b537-486cbe46d19f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:51:53.227420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:51:53.228064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:51:53.228349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:51:53.228625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:51:53.231108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:51:53.247598 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:51:53.249036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:51:53.261890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1237/2484] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:51:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:51:54.461237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4a2e8-2f65-4e11-b100-f75cfdbf76f7 service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:51:54.470858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4a2e8-2f65-4e11-b100-f75cfdbf76f7 service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:51:54.475004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb6189-58d4-4e36-886a-696820425aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:51:54.475637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6189-58d4-4e36-886a-696820425aff service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:51:54.475924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6189-58d4-4e36-886a-696820425aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:51:54.476280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb6189-58d4-4e36-886a-696820425aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:51:54.478291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-91bb6189-58d4-4e36-886a-696820425aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:51:54.493507 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb6189-58d4-4e36-886a-696820425aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:51:54.495100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb6189-58d4-4e36-886a-696820425aff service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:51:54.507036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1248/2485] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:51:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:03.256234 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=31 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:04.501376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=41 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:07.962705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:07.964640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:07.976149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f1b3b-7d43-4b62-a3f3-12ad82614076 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:07.979954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:07.980596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:07.980881 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:07.981162 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:07.982992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:08.056883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:08.058628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:08.070930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1238/2486] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:10.788515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e1024-5705-4a74-80ea-29b2e7138f0f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:10.789430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e1024-5705-4a74-80ea-29b2e7138f0f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:10.789916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e1024-5705-4a74-80ea-29b2e7138f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:10.811158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-895e1024-5705-4a74-80ea-29b2e7138f0f None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:52:10.812548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-895e1024-5705-4a74-80ea-29b2e7138f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:10.820537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1249/2487] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:52:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:52:10.832753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:10.844778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef28cc-cf73-4f2b-b782-4b12d26d42b0 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:10.851548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813eb06-441b-47aa-a848-3cea22d93f38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:10.852330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813eb06-441b-47aa-a848-3cea22d93f38 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:10.852615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813eb06-441b-47aa-a848-3cea22d93f38 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:10.852894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813eb06-441b-47aa-a848-3cea22d93f38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:10.861710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813eb06-441b-47aa-a848-3cea22d93f38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:10.863664 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813eb06-441b-47aa-a848-3cea22d93f38 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:10.873314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1239/2488] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:52:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:52:20.803263 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:20.869513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=36 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:30.850437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e1024-5705-4a74-80ea-29b2e7138f0f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:30.860338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e1024-5705-4a74-80ea-29b2e7138f0f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:30.863844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:30.864591 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:30.864873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:30.865142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:30.867047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:30.925365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:30.926897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:30.937105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1250/2489] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:32.169080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813eb06-441b-47aa-a848-3cea22d93f38 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:32.179611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813eb06-441b-47aa-a848-3cea22d93f38 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:32.183438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:32.184144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:32.184427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:32.184734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:32.186542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:32.196711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:32.198168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:32.206605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1240/2490] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:33.898391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:33.910964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255937b3-2be7-4eec-bf85-1f18f7ee04b3 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:33.917283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d97aa-1d98-4bf1-8fc0-daeaf38bf993 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:33.917923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d97aa-1d98-4bf1-8fc0-daeaf38bf993 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:33.918237 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d97aa-1d98-4bf1-8fc0-daeaf38bf993 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:33.918509 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d97aa-1d98-4bf1-8fc0-daeaf38bf993 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:33.920687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ef9d97aa-1d98-4bf1-8fc0-daeaf38bf993 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:33.933528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d97aa-1d98-4bf1-8fc0-daeaf38bf993 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:33.935205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d97aa-1d98-4bf1-8fc0-daeaf38bf993 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:33.946051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1251/2491] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:35.279381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:35.280793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:35.297554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db077a-face-4f9b-a182-c1645ee4b417 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:35.303008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:35.303638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:35.303990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:35.304280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:35.306055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:35.317819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:35.319375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:35.329921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1241/2492] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:37.088275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c6c2-8574-4d97-8b41-30b2b67e8fa2 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:37.088275 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c6c2-8574-4d97-8b41-30b2b67e8fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:37.088849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c6c2-8574-4d97-8b41-30b2b67e8fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:37.108562 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-e567c6c2-8574-4d97-8b41-30b2b67e8fa2 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:52:37.109749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e567c6c2-8574-4d97-8b41-30b2b67e8fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:37.116937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1252/2493] 10.222.0.70 () {58 vars in 967 bytes} [Wed May 18 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:52:37.129897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:37.142518 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1070142-ba5a-48db-8037-963d0450e593 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:37.148170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef032a4e-61de-4c7f-94ec-3d4f94f7dba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:37.149525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef032a4e-61de-4c7f-94ec-3d4f94f7dba8 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:37.149818 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef032a4e-61de-4c7f-94ec-3d4f94f7dba8 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:37.150132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef032a4e-61de-4c7f-94ec-3d4f94f7dba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:37.159339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef032a4e-61de-4c7f-94ec-3d4f94f7dba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:37.161015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef032a4e-61de-4c7f-94ec-3d4f94f7dba8 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:37.170270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1242/2494] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:52:39.674527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567c6c2-8574-4d97-8b41-30b2b67e8fa2 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:39.684589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567c6c2-8574-4d97-8b41-30b2b67e8fa2 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:39.688219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:39.690598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:39.690598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:39.690598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:39.691223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:39.703718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:39.705143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:39.715804 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1253/2495] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:52:46.395713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef032a4e-61de-4c7f-94ec-3d4f94f7dba8 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:46.408687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef032a4e-61de-4c7f-94ec-3d4f94f7dba8 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:46.418436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:46.419889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:46.420391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:46.421059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:46.423147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:46.466235 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:46.469113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:46.497712 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1243/2496] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:47.340793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:47.342380 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:47.355765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1aedd6-43de-4fe4-a258-6de9871f48b9 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:47.360461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:47.365719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:47.365719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:47.365719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] PATH_INFO: `/v3/users/d750ba769f214a88add671cf540a49cd` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:47.365719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d750ba769f214a88add671cf540a49cd)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:47.365719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:47.530139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd750ba769f214a88add671cf540a49cd'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:47.530798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd750ba769f214a88add671cf540a49cd'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:47.607868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd750ba769f214a88add671cf540a49cd'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:47.620143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd750ba769f214a88add671cf540a49cd'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:47.626988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd750ba769f214a88add671cf540a49cd'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:47.633749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1254/2497] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:52:47 2022] DELETE /identity/v3/users/d750ba769f214a88add671cf540a49cd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:52:47.849609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:47.863268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13826399-4c37-4381-9eb0-a598b0b5c452 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:47.927124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:47.928019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:47.928297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:47.928568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] PATH_INFO: `/v3/projects/5fc1f2d036414a81ba6f2e60e8292ab6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:47.929736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc1f2d036414a81ba6f2e60e8292ab6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:47.931714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:48.063251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc1f2d036414a81ba6f2e60e8292ab6', 'request_id': 'req-b31f910d-bde4-43a9-8205-4f618bf535d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.168019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc1f2d036414a81ba6f2e60e8292ab6', 'request_id': 'req-b31f910d-bde4-43a9-8205-4f618bf535d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.174318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc1f2d036414a81ba6f2e60e8292ab6', 'request_id': 'req-b31f910d-bde4-43a9-8205-4f618bf535d7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.186961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] The token cache is being invalidate because project 5fc1f2d036414a81ba6f2e60e8292ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:52:48.187249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.187899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.189652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1244/2498] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:52:47 2022] DELETE /identity/v3/projects/5fc1f2d036414a81ba6f2e60e8292ab6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:52:48.193729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:48.195822 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:48.208921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d01e4-fb90-419d-be82-de1967013ffd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:48.243320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:48.266503 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:48.267363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:48.267640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:48.267913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] PATH_INFO: `/v3/users/d2dccab6effe447d912825d68c3366fe` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:48.269115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2dccab6effe447d912825d68c3366fe)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:48.271060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:48.491015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2dccab6effe447d912825d68c3366fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.491686 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2dccab6effe447d912825d68c3366fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.577489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2dccab6effe447d912825d68c3366fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.587730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2dccab6effe447d912825d68c3366fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.594853 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2dccab6effe447d912825d68c3366fe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:48.600808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1255/2499] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:52:48 2022] DELETE /identity/v3/users/d2dccab6effe447d912825d68c3366fe => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:52:48.850400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:48.852122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:48.866544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f910d-bde4-43a9-8205-4f618bf535d7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:48.872652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:48.924813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:48.925677 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:48.925952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:48.926252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] PATH_INFO: `/v3/projects/3fa4e3a617184934be48331de9c16e2a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:48.927450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa4e3a617184934be48331de9c16e2a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:48.930057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:49.029148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa4e3a617184934be48331de9c16e2a', 'request_id': 'req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:49.093838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa4e3a617184934be48331de9c16e2a', 'request_id': 'req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:49.099928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa4e3a617184934be48331de9c16e2a', 'request_id': 'req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:49.111744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] The token cache is being invalidate because project 3fa4e3a617184934be48331de9c16e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:52:49.112030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:49.112660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:49.114218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1245/2500] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:52:48 2022] DELETE /identity/v3/projects/3fa4e3a617184934be48331de9c16e2a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:52:52.567371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:52.568770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:52.625265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3c0f1-d98e-47ed-a7ba-3a4f7d863ccb admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:52.671274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:52.671909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:52.672185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:52.672454 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:52.674211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:52.701044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:52.737390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:52.738770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:52.749211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1256/2501] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:56.345543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:56.347060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:56.360884 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7e0c4-68a8-413f-a2e8-d726d6813f9d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:56.365663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:56.366593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:56.366871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:56.367149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] PATH_INFO: `/v3/users/f2b45df9a7cd466593d5c8a4f30bde53` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:56.368417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b45df9a7cd466593d5c8a4f30bde53)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:56.370361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:56.528794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b45df9a7cd466593d5c8a4f30bde53'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:56.603006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b45df9a7cd466593d5c8a4f30bde53'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:56.610585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b45df9a7cd466593d5c8a4f30bde53'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:56.611286 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b45df9a7cd466593d5c8a4f30bde53'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:56.623974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-44a0aa90-1407-41a9-8e79-d1c4fff6bad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b45df9a7cd466593d5c8a4f30bde53'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:56.630292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1246/2502] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:52:56 2022] DELETE /identity/v3/users/f2b45df9a7cd466593d5c8a4f30bde53 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:52:56.935963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:56.965086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbbe20f-4af0-419b-8488-58fc2c027c73 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:57.007656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:57.008514 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.008790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.009066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] PATH_INFO: `/v3/projects/6422f1b1118143e4b8ef54927212ca97` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.010285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6422f1b1118143e4b8ef54927212ca97)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:57.012196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:57.139341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6422f1b1118143e4b8ef54927212ca97', 'request_id': 'req-7087f58c-684f-4ec9-b73b-0b55ef93609f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:57.196725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6422f1b1118143e4b8ef54927212ca97', 'request_id': 'req-7087f58c-684f-4ec9-b73b-0b55ef93609f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:57.202711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6422f1b1118143e4b8ef54927212ca97', 'request_id': 'req-7087f58c-684f-4ec9-b73b-0b55ef93609f'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:57.214898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] The token cache is being invalidate because project 6422f1b1118143e4b8ef54927212ca97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:52:57.215183 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:57.215821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-7087f58c-684f-4ec9-b73b-0b55ef93609f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:52:57.217361 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1257/2503] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:52:56 2022] DELETE /identity/v3/projects/6422f1b1118143e4b8ef54927212ca97 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:52:57.222960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1910-d9c8-4768-961f-bb9439fbfb3c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.223319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1910-d9c8-4768-961f-bb9439fbfb3c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.223621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b1910-d9c8-4768-961f-bb9439fbfb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.241974 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7c6b1910-d9c8-4768-961f-bb9439fbfb3c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:52:57.243295 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7c6b1910-d9c8-4768-961f-bb9439fbfb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:57.248935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:57.303425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1247/2504] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:52:57.311685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bacc4-0c3a-4c75-beb2-84fb76927dab None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.311996 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bacc4-0c3a-4c75-beb2-84fb76927dab None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.312274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bacc4-0c3a-4c75-beb2-84fb76927dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.332042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b44bacc4-0c3a-4c75-beb2-84fb76927dab None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:52:57.333278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b44bacc4-0c3a-4c75-beb2-84fb76927dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:57.341848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1258/2505] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:52:57.345933 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b1910-d9c8-4768-961f-bb9439fbfb3c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:57.356749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b1910-d9c8-4768-961f-bb9439fbfb3c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:57.361556 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:57.362240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.362525 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.362801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.363579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:52:57.363887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:57.365477 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:57.376930 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1248/2506] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:52:57.381290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bacc4-0c3a-4c75-beb2-84fb76927dab None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:57.390997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bacc4-0c3a-4c75-beb2-84fb76927dab None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:57.395484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd04b-ad2e-41af-86a9-0f55c8625e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:57.396107 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd04b-ad2e-41af-86a9-0f55c8625e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.396384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd04b-ad2e-41af-86a9-0f55c8625e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.396648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd04b-ad2e-41af-86a9-0f55c8625e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.397327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdd04b-ad2e-41af-86a9-0f55c8625e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:57.400429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdd04b-ad2e-41af-86a9-0f55c8625e36 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:57.483186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1259/2507] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:52:57 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:52:57.487264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:57.497279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6be54-725b-4361-b51b-6700d9ba3a39 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:57.552446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ff68-88a4-4ef9-a060-a958e65fee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:57.553103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ff68-88a4-4ef9-a060-a958e65fee7d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.553383 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ff68-88a4-4ef9-a060-a958e65fee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.553655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616ff68-88a4-4ef9-a060-a958e65fee7d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.554387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616ff68-88a4-4ef9-a060-a958e65fee7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:57.556896 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616ff68-88a4-4ef9-a060-a958e65fee7d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:57.647707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1249/2508] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:52:57 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:52:57.652588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd04b-ad2e-41af-86a9-0f55c8625e36 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:57.662917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd04b-ad2e-41af-86a9-0f55c8625e36 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:57.667974 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c7186-517c-4a5a-8ffa-3e97fa172da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:57.668623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c7186-517c-4a5a-8ffa-3e97fa172da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.668906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c7186-517c-4a5a-8ffa-3e97fa172da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.669527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c7186-517c-4a5a-8ffa-3e97fa172da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.670280 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c7186-517c-4a5a-8ffa-3e97fa172da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:57.671889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c7186-517c-4a5a-8ffa-3e97fa172da0 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:57.682341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1260/2509] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:52:57.686324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ff68-88a4-4ef9-a060-a958e65fee7d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:57.696770 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616ff68-88a4-4ef9-a060-a958e65fee7d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:57.701455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304b3d8-0e05-4a88-bb29-ff101d4a300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:57.702132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b3d8-0e05-4a88-bb29-ff101d4a300c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.702416 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b3d8-0e05-4a88-bb29-ff101d4a300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.702684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304b3d8-0e05-4a88-bb29-ff101d4a300c admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.703393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304b3d8-0e05-4a88-bb29-ff101d4a300c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:57.704957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304b3d8-0e05-4a88-bb29-ff101d4a300c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:57.715569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1250/2510] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:52:57.719615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c7186-517c-4a5a-8ffa-3e97fa172da0 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:57.729659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c7186-517c-4a5a-8ffa-3e97fa172da0 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:57.734341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:57.735139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.735416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.735687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] PATH_INFO: `/v3/projects/16725385a59a497e81c94d4f1ebd7cfb/users/0918ca39cd954c98b90bac3048c8074b/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.746978 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:57.750945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16725385a59a497e81c94d4f1ebd7cfb, user_id=0918ca39cd954c98b90bac3048c8074b, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:57.753672 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:57.825344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1261/2511] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:52:57 2022] PUT /identity/v3/projects/16725385a59a497e81c94d4f1ebd7cfb/users/0918ca39cd954c98b90bac3048c8074b/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:52:57.830697 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb136ae-7b19-4df5-95a8-97ada84ecbb0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.830983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb136ae-7b19-4df5-95a8-97ada84ecbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.831260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb136ae-7b19-4df5-95a8-97ada84ecbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.849437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ceb136ae-7b19-4df5-95a8-97ada84ecbb0 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:52:57.852098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ceb136ae-7b19-4df5-95a8-97ada84ecbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:57.909249 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1251/2512] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:52:57.919612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:57.921365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:57.978656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73812a-0ab5-48a5-810f-8e18a900b2d9 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:57.982367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79fa0a-82a5-48bf-925e-7d9c9ac72ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:57.983001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79fa0a-82a5-48bf-925e-7d9c9ac72ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:57.983279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79fa0a-82a5-48bf-925e-7d9c9ac72ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:57.983547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79fa0a-82a5-48bf-925e-7d9c9ac72ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:57.993271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79fa0a-82a5-48bf-925e-7d9c9ac72ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:57.994637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79fa0a-82a5-48bf-925e-7d9c9ac72ad0 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:58.004527 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1262/2513] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:52:59.141417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eb451-091c-4750-b30f-8fd1c392ae0a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:59.141984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eb451-091c-4750-b30f-8fd1c392ae0a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:59.141984 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8eb451-091c-4750-b30f-8fd1c392ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:59.170129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ac8eb451-091c-4750-b30f-8fd1c392ae0a None None] MFA Rules not processed for user `0918ca39cd954c98b90bac3048c8074b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:52:59.171432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ac8eb451-091c-4750-b30f-8fd1c392ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:52:59.176536 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:59.238584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1252/2514] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:52:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:52:59.243653 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79fa0a-82a5-48bf-925e-7d9c9ac72ad0 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:59.254493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79fa0a-82a5-48bf-925e-7d9c9ac72ad0 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:59.259656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f284d0a-d125-41eb-b341-4bc0c601c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:59.260298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f284d0a-d125-41eb-b341-4bc0c601c3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:59.260573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f284d0a-d125-41eb-b341-4bc0c601c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:59.260842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f284d0a-d125-41eb-b341-4bc0c601c3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:59.261515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f284d0a-d125-41eb-b341-4bc0c601c3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:59.263442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f284d0a-d125-41eb-b341-4bc0c601c3dd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:59.359306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1263/2515] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:52:59 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:52:59.360232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eb451-091c-4750-b30f-8fd1c392ae0a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:59.371796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8eb451-091c-4750-b30f-8fd1c392ae0a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:59.426927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16f21f-e97e-4205-9de0-77ea211b2b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:59.427585 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16f21f-e97e-4205-9de0-77ea211b2b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:59.427863 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16f21f-e97e-4205-9de0-77ea211b2b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:59.428140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16f21f-e97e-4205-9de0-77ea211b2b6c admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:59.428808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16f21f-e97e-4205-9de0-77ea211b2b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:59.431241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16f21f-e97e-4205-9de0-77ea211b2b6c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:59.577934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1253/2516] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:52:59 2022] POST /identity/v3/users => generated 309 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:52:59.580195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f284d0a-d125-41eb-b341-4bc0c601c3dd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:59.589902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f284d0a-d125-41eb-b341-4bc0c601c3dd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:59.594410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7d57-b2d0-40ba-9164-9496b5c5ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:59.595062 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7d57-b2d0-40ba-9164-9496b5c5ee2d admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:59.595337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7d57-b2d0-40ba-9164-9496b5c5ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:59.595607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7d57-b2d0-40ba-9164-9496b5c5ee2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:59.596328 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea7d57-b2d0-40ba-9164-9496b5c5ee2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:59.597917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea7d57-b2d0-40ba-9164-9496b5c5ee2d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:59.609158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1264/2517] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:52:59.615811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16f21f-e97e-4205-9de0-77ea211b2b6c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:59.626521 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16f21f-e97e-4205-9de0-77ea211b2b6c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:59.631180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578d2b7-0b59-4df9-a417-19013c2d3b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:59.632050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578d2b7-0b59-4df9-a417-19013c2d3b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:59.632333 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578d2b7-0b59-4df9-a417-19013c2d3b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:59.632764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578d2b7-0b59-4df9-a417-19013c2d3b5f admin admin] PATH_INFO: `/v3/projects/c1a5ade6e0e140c9a5e753ec98af4f31/users/c5b2fb4c04ef4c53b1de709b6406e440/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:59.648031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578d2b7-0b59-4df9-a417-19013c2d3b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a5ade6e0e140c9a5e753ec98af4f31, user_id=c5b2fb4c04ef4c53b1de709b6406e440, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:59.650763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578d2b7-0b59-4df9-a417-19013c2d3b5f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:59.710320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1254/2518] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:52:59 2022] PUT /identity/v3/projects/c1a5ade6e0e140c9a5e753ec98af4f31/users/c5b2fb4c04ef4c53b1de709b6406e440/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:52:59.714440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7d57-b2d0-40ba-9164-9496b5c5ee2d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:59.724270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7d57-b2d0-40ba-9164-9496b5c5ee2d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:59.780407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b2f35-f15a-44ce-a193-344da881e0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:59.781057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2f35-f15a-44ce-a193-344da881e0be admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:59.781338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2f35-f15a-44ce-a193-344da881e0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:59.781612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b2f35-f15a-44ce-a193-344da881e0be admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:59.782376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2f35-f15a-44ce-a193-344da881e0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:59.783964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b2f35-f15a-44ce-a193-344da881e0be admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:59.794491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1265/2519] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:52:59.798612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578d2b7-0b59-4df9-a417-19013c2d3b5f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:52:59.809389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578d2b7-0b59-4df9-a417-19013c2d3b5f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:52:59.813872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e770ac0-41f5-40cf-a8b3-000e66cc4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:52:59.814797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770ac0-41f5-40cf-a8b3-000e66cc4cff admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:52:59.815075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770ac0-41f5-40cf-a8b3-000e66cc4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:52:59.815341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e770ac0-41f5-40cf-a8b3-000e66cc4cff admin admin] PATH_INFO: `/v3/projects/c1a5ade6e0e140c9a5e753ec98af4f31/users/c5b2fb4c04ef4c53b1de709b6406e440/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:52:59.817288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e770ac0-41f5-40cf-a8b3-000e66cc4cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a5ade6e0e140c9a5e753ec98af4f31, user_id=c5b2fb4c04ef4c53b1de709b6406e440, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:52:59.819916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e770ac0-41f5-40cf-a8b3-000e66cc4cff admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:52:59.830748 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1255/2520] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:52:59 2022] PUT /identity/v3/projects/c1a5ade6e0e140c9a5e753ec98af4f31/users/c5b2fb4c04ef4c53b1de709b6406e440/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:53:01.007880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527dc8-7613-4092-8794-d455a45c0051 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:01.008721 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527dc8-7613-4092-8794-d455a45c0051 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:01.008721 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527dc8-7613-4092-8794-d455a45c0051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:01.049416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-10527dc8-7613-4092-8794-d455a45c0051 None None] MFA Rules not processed for user `c5b2fb4c04ef4c53b1de709b6406e440`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:01.050726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-10527dc8-7613-4092-8794-d455a45c0051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:01.099728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:01.125387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1266/2521] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:53:02.464505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e770ac0-41f5-40cf-a8b3-000e66cc4cff admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:02.526860 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e770ac0-41f5-40cf-a8b3-000e66cc4cff admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:02.531431 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:02.532292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:02.532568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:02.532837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] PATH_INFO: `/v3/users/0918ca39cd954c98b90bac3048c8074b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:02.534035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0918ca39cd954c98b90bac3048c8074b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:02.536002 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:02.541509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:02.753171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0918ca39cd954c98b90bac3048c8074b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:02.824740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0918ca39cd954c98b90bac3048c8074b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:02.832130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0918ca39cd954c98b90bac3048c8074b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:02.832753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0918ca39cd954c98b90bac3048c8074b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:02.845210 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0918ca39cd954c98b90bac3048c8074b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:02.851154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1256/2522] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:02 2022] DELETE /identity/v3/users/0918ca39cd954c98b90bac3048c8074b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:03.083690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10527dc8-7613-4092-8794-d455a45c0051 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:03.095673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10527dc8-7613-4092-8794-d455a45c0051 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:03.152081 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:03.152931 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:03.153204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:03.153470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] PATH_INFO: `/v3/projects/16725385a59a497e81c94d4f1ebd7cfb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:03.154643 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=16725385a59a497e81c94d4f1ebd7cfb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:03.156532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:03.258725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16725385a59a497e81c94d4f1ebd7cfb', 'request_id': 'req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.344322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16725385a59a497e81c94d4f1ebd7cfb', 'request_id': 'req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.350055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16725385a59a497e81c94d4f1ebd7cfb', 'request_id': 'req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.361657 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] The token cache is being invalidate because project 16725385a59a497e81c94d4f1ebd7cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:03.366715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.366715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.366715 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1267/2523] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:03 2022] DELETE /identity/v3/projects/16725385a59a497e81c94d4f1ebd7cfb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:03.368450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:03.369828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:03.382921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf57c7-924d-4205-8181-7256b4f1bc72 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:03.440309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:03.441243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:03.441527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:03.441805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] PATH_INFO: `/v3/users/c5b2fb4c04ef4c53b1de709b6406e440` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:03.443019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b2fb4c04ef4c53b1de709b6406e440)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:03.444980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:03.607897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b2fb4c04ef4c53b1de709b6406e440'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.687335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b2fb4c04ef4c53b1de709b6406e440'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.694741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b2fb4c04ef4c53b1de709b6406e440'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.695399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b2fb4c04ef4c53b1de709b6406e440'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.708145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-cb2b0ed1-de32-4216-b115-80db89e66fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b2fb4c04ef4c53b1de709b6406e440'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:03.709568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:03.715346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1257/2524] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:03 2022] DELETE /identity/v3/users/c5b2fb4c04ef4c53b1de709b6406e440 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:03.973151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:03.974605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:03.987871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcd9c1-3b19-4185-bbf7-1e4deb3d5abe admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:04.045266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:04.046165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.046441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.046714 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] PATH_INFO: `/v3/projects/c1a5ade6e0e140c9a5e753ec98af4f31` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.047903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a5ade6e0e140c9a5e753ec98af4f31)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:04.049828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:04.061898 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:04.151036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a5ade6e0e140c9a5e753ec98af4f31', 'request_id': 'req-a4830185-ffcf-41c3-bc85-ead45f7cca82'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:04.207415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a5ade6e0e140c9a5e753ec98af4f31', 'request_id': 'req-a4830185-ffcf-41c3-bc85-ead45f7cca82'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:04.213187 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a5ade6e0e140c9a5e753ec98af4f31', 'request_id': 'req-a4830185-ffcf-41c3-bc85-ead45f7cca82'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:04.225474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] The token cache is being invalidate because project c1a5ade6e0e140c9a5e753ec98af4f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:04.225474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:04.225474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-a4830185-ffcf-41c3-bc85-ead45f7cca82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:04.226529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1268/2525] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:03 2022] DELETE /identity/v3/projects/c1a5ade6e0e140c9a5e753ec98af4f31 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:04.232223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899add6b-321c-4f79-ac31-d1d2f3728092 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.232639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899add6b-321c-4f79-ac31-d1d2f3728092 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.232928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899add6b-321c-4f79-ac31-d1d2f3728092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.251597 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-899add6b-321c-4f79-ac31-d1d2f3728092 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:04.252785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-899add6b-321c-4f79-ac31-d1d2f3728092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:04.310832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1258/2526] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:04.318676 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae05-d407-49b9-8432-1a5a0c44c918 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.318959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae05-d407-49b9-8432-1a5a0c44c918 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.319256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae05-d407-49b9-8432-1a5a0c44c918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.338750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0bf9ae05-d407-49b9-8432-1a5a0c44c918 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:04.339968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0bf9ae05-d407-49b9-8432-1a5a0c44c918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:04.347995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1269/2527] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:04.352740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899add6b-321c-4f79-ac31-d1d2f3728092 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:04.362412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899add6b-321c-4f79-ac31-d1d2f3728092 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:04.367122 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:04.368542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.368847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.369120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.369834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:53:04.370171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:04.371762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:04.383318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1259/2528] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:53:04.387339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ae05-d407-49b9-8432-1a5a0c44c918 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:04.396413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ae05-d407-49b9-8432-1a5a0c44c918 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:04.401022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e87c-f40b-442d-b868-8d7f6bb76a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:04.401649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e87c-f40b-442d-b868-8d7f6bb76a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.401924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e87c-f40b-442d-b868-8d7f6bb76a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.402227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e87c-f40b-442d-b868-8d7f6bb76a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.402931 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1e87c-f40b-442d-b868-8d7f6bb76a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:04.404818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1e87c-f40b-442d-b868-8d7f6bb76a4a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:04.516773 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1270/2529] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:04 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:04.521088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:04.531747 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc248b74-60a3-4f18-93b2-cdac4c60122f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:04.594740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa34f0e-8128-4cfa-ae3e-07079c083123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:04.595414 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa34f0e-8128-4cfa-ae3e-07079c083123 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.595700 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa34f0e-8128-4cfa-ae3e-07079c083123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.595977 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa34f0e-8128-4cfa-ae3e-07079c083123 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.596679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa34f0e-8128-4cfa-ae3e-07079c083123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:04.598642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa34f0e-8128-4cfa-ae3e-07079c083123 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:04.700626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1260/2530] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:04 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:04.705124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e87c-f40b-442d-b868-8d7f6bb76a4a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:04.715554 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e87c-f40b-442d-b868-8d7f6bb76a4a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:04.720113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e959f-2632-439f-842b-1eab96bfb2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:04.720777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e959f-2632-439f-842b-1eab96bfb2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.721054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e959f-2632-439f-842b-1eab96bfb2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.721324 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e959f-2632-439f-842b-1eab96bfb2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.722059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e959f-2632-439f-842b-1eab96bfb2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:04.723637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e959f-2632-439f-842b-1eab96bfb2e8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:04.734010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1271/2531] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:53:04.737808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa34f0e-8128-4cfa-ae3e-07079c083123 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:04.748232 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa34f0e-8128-4cfa-ae3e-07079c083123 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:04.752869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77150ea-54b0-4d85-b3eb-e1db2264a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:04.753541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77150ea-54b0-4d85-b3eb-e1db2264a93b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.753826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77150ea-54b0-4d85-b3eb-e1db2264a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.754152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77150ea-54b0-4d85-b3eb-e1db2264a93b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.754875 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77150ea-54b0-4d85-b3eb-e1db2264a93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:04.756455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77150ea-54b0-4d85-b3eb-e1db2264a93b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:04.767110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1261/2532] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:04.771063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e959f-2632-439f-842b-1eab96bfb2e8 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:04.781283 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e959f-2632-439f-842b-1eab96bfb2e8 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:04.785836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159f45d-66ba-4564-8ddc-0a0f4ac52441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:04.786727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f45d-66ba-4564-8ddc-0a0f4ac52441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.787004 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f45d-66ba-4564-8ddc-0a0f4ac52441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.787272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159f45d-66ba-4564-8ddc-0a0f4ac52441 admin admin] PATH_INFO: `/v3/projects/9e5c74d88aac428cb2b53b46e494c071/users/44751df8bedc4fbd81d8c9789825cc67/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.801929 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159f45d-66ba-4564-8ddc-0a0f4ac52441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5c74d88aac428cb2b53b46e494c071, user_id=44751df8bedc4fbd81d8c9789825cc67, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:04.804594 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159f45d-66ba-4564-8ddc-0a0f4ac52441 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:04.871069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1272/2533] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:04 2022] PUT /identity/v3/projects/9e5c74d88aac428cb2b53b46e494c071/users/44751df8bedc4fbd81d8c9789825cc67/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:04.884288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e12443-8510-432a-a6bf-f4af10675290 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:04.884606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e12443-8510-432a-a6bf-f4af10675290 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:04.884888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e12443-8510-432a-a6bf-f4af10675290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:04.911713 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a1e12443-8510-432a-a6bf-f4af10675290 None None] MFA Rules not processed for user `44751df8bedc4fbd81d8c9789825cc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:04.912454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a1e12443-8510-432a-a6bf-f4af10675290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:04.967438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:04.977689 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1262/2534] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:04.982601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159f45d-66ba-4564-8ddc-0a0f4ac52441 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:05.042783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159f45d-66ba-4564-8ddc-0a0f4ac52441 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:05.047615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc94c20-fca3-4e43-b413-7d4e1bafb7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:05.048288 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94c20-fca3-4e43-b413-7d4e1bafb7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:05.048567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94c20-fca3-4e43-b413-7d4e1bafb7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:05.048838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94c20-fca3-4e43-b413-7d4e1bafb7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:05.049522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc94c20-fca3-4e43-b413-7d4e1bafb7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:05.051441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc94c20-fca3-4e43-b413-7d4e1bafb7e6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:05.134137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1273/2535] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:04 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:05.138252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e12443-8510-432a-a6bf-f4af10675290 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:05.148733 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e12443-8510-432a-a6bf-f4af10675290 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:05.206878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e539e-e0a7-48ec-a2b9-9ceccf8e7536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:05.207541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e539e-e0a7-48ec-a2b9-9ceccf8e7536 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:05.207824 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e539e-e0a7-48ec-a2b9-9ceccf8e7536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:05.208100 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e539e-e0a7-48ec-a2b9-9ceccf8e7536 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:05.208794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e539e-e0a7-48ec-a2b9-9ceccf8e7536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:05.210747 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e539e-e0a7-48ec-a2b9-9ceccf8e7536 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:05.276519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1263/2536] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:05 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:53:05.280485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc94c20-fca3-4e43-b413-7d4e1bafb7e6 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:05.291294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc94c20-fca3-4e43-b413-7d4e1bafb7e6 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:05.297972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030c5c8-6f08-4b28-97a0-0a8c95ba80b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:05.297972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c5c8-6f08-4b28-97a0-0a8c95ba80b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:05.297972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c5c8-6f08-4b28-97a0-0a8c95ba80b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:05.297972 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030c5c8-6f08-4b28-97a0-0a8c95ba80b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:05.298431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030c5c8-6f08-4b28-97a0-0a8c95ba80b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:05.299549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030c5c8-6f08-4b28-97a0-0a8c95ba80b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:05.309899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1274/2537] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:05.314110 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e539e-e0a7-48ec-a2b9-9ceccf8e7536 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:05.324086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e539e-e0a7-48ec-a2b9-9ceccf8e7536 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:05.328856 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834eb7e-d462-4656-893e-c4e3909b22a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:05.329718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834eb7e-d462-4656-893e-c4e3909b22a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:05.329996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834eb7e-d462-4656-893e-c4e3909b22a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:05.330301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834eb7e-d462-4656-893e-c4e3909b22a6 admin admin] PATH_INFO: `/v3/projects/3678fd64afc54519ad1c6f5ff866e93b/users/627ec732bd31425ba8c32650e76a90eb/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:05.345415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834eb7e-d462-4656-893e-c4e3909b22a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3678fd64afc54519ad1c6f5ff866e93b, user_id=627ec732bd31425ba8c32650e76a90eb, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:05.348105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834eb7e-d462-4656-893e-c4e3909b22a6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:05.440514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1264/2538] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:05 2022] PUT /identity/v3/projects/3678fd64afc54519ad1c6f5ff866e93b/users/627ec732bd31425ba8c32650e76a90eb/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:05.444646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030c5c8-6f08-4b28-97a0-0a8c95ba80b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:05.454995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030c5c8-6f08-4b28-97a0-0a8c95ba80b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:05.463271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:05.510909 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5b733-157b-4693-bc5c-66b059e906d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:05.511558 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5b733-157b-4693-bc5c-66b059e906d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:05.511834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5b733-157b-4693-bc5c-66b059e906d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:05.512103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5b733-157b-4693-bc5c-66b059e906d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:05.512809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5b733-157b-4693-bc5c-66b059e906d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:05.514468 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5b733-157b-4693-bc5c-66b059e906d7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:05.524703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1275/2539] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:05.528817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834eb7e-d462-4656-893e-c4e3909b22a6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:05.538953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834eb7e-d462-4656-893e-c4e3909b22a6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:05.544382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:05.545243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:05.545517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:05.545784 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] PATH_INFO: `/v3/projects/3678fd64afc54519ad1c6f5ff866e93b/users/627ec732bd31425ba8c32650e76a90eb/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:05.547750 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3678fd64afc54519ad1c6f5ff866e93b, user_id=627ec732bd31425ba8c32650e76a90eb, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:05.550528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:05.560529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1265/2540] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:05 2022] PUT /identity/v3/projects/3678fd64afc54519ad1c6f5ff866e93b/users/627ec732bd31425ba8c32650e76a90eb/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:05.570395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdac51-6c09-4ff7-b6cf-73896c1add3c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:05.570685 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdac51-6c09-4ff7-b6cf-73896c1add3c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:05.571574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdac51-6c09-4ff7-b6cf-73896c1add3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:05.598357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d8bdac51-6c09-4ff7-b6cf-73896c1add3c None None] MFA Rules not processed for user `627ec732bd31425ba8c32650e76a90eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:05.599555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d8bdac51-6c09-4ff7-b6cf-73896c1add3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:05.666236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1276/2541] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:53:05.677131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:05.678936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:05.736638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e1ec1-d073-496b-8469-485cd726f7eb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:05.740247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf718a97-91ab-4daf-9902-24a8f32e43b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:05.740876 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf718a97-91ab-4daf-9902-24a8f32e43b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:05.741164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf718a97-91ab-4daf-9902-24a8f32e43b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:05.741437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf718a97-91ab-4daf-9902-24a8f32e43b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:05.750675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf718a97-91ab-4daf-9902-24a8f32e43b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:05.752139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf718a97-91ab-4daf-9902-24a8f32e43b2 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:05.762541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1266/2542] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:08.456605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdac51-6c09-4ff7-b6cf-73896c1add3c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:08.518843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdac51-6c09-4ff7-b6cf-73896c1add3c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:08.523415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:08.524601 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:08.524869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:08.525149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] PATH_INFO: `/v3/users/44751df8bedc4fbd81d8c9789825cc67` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:08.526392 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44751df8bedc4fbd81d8c9789825cc67)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:08.528299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:08.736383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:08.745947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44751df8bedc4fbd81d8c9789825cc67'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:08.746655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44751df8bedc4fbd81d8c9789825cc67'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:08.813172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44751df8bedc4fbd81d8c9789825cc67'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:08.825412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44751df8bedc4fbd81d8c9789825cc67'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:08.831866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44751df8bedc4fbd81d8c9789825cc67'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:08.837635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1277/2543] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:08 2022] DELETE /identity/v3/users/44751df8bedc4fbd81d8c9789825cc67 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:08.842329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885b3d-7ed0-4e67-b71a-76563af1795f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:08.842944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885b3d-7ed0-4e67-b71a-76563af1795f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:08.842944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c885b3d-7ed0-4e67-b71a-76563af1795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:08.860632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2c885b3d-7ed0-4e67-b71a-76563af1795f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:08.861822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2c885b3d-7ed0-4e67-b71a-76563af1795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:08.905808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:08.921484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1267/2544] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:08.932077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:08.933480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:08.992984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca9447-d5a2-4de0-b141-4b443e474b47 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:08.996577 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20255ed-5958-44e0-b719-8e09079ed943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:08.997218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20255ed-5958-44e0-b719-8e09079ed943 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:08.997493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20255ed-5958-44e0-b719-8e09079ed943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:08.997761 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20255ed-5958-44e0-b719-8e09079ed943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:09.007278 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20255ed-5958-44e0-b719-8e09079ed943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:09.008731 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20255ed-5958-44e0-b719-8e09079ed943 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:09.018151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1278/2545] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:53:09.414549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885b3d-7ed0-4e67-b71a-76563af1795f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:09.416022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2c885b3d-7ed0-4e67-b71a-76563af1795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:09.428167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c885b3d-7ed0-4e67-b71a-76563af1795f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:09.432987 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:09.433872 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:09.434193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:09.434460 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] PATH_INFO: `/v3/projects/9e5c74d88aac428cb2b53b46e494c071` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:09.435655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5c74d88aac428cb2b53b46e494c071)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:09.437557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:09.557206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5c74d88aac428cb2b53b46e494c071', 'request_id': 'req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:09.647225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5c74d88aac428cb2b53b46e494c071', 'request_id': 'req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:09.653642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5c74d88aac428cb2b53b46e494c071', 'request_id': 'req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:09.664669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] The token cache is being invalidate because project 9e5c74d88aac428cb2b53b46e494c071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:09.664890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:09.665531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:09.667084 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1268/2546] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:09 2022] DELETE /identity/v3/projects/9e5c74d88aac428cb2b53b46e494c071 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:09.671306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20255ed-5958-44e0-b719-8e09079ed943 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:09.681108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20255ed-5958-44e0-b719-8e09079ed943 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:09.736041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:09.736896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:09.737178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:09.737446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] PATH_INFO: `/v3/users/627ec732bd31425ba8c32650e76a90eb` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:09.738639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627ec732bd31425ba8c32650e76a90eb)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:09.740544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:09.941873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627ec732bd31425ba8c32650e76a90eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:09.942485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627ec732bd31425ba8c32650e76a90eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.034716 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627ec732bd31425ba8c32650e76a90eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.036859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:10.049160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627ec732bd31425ba8c32650e76a90eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.056742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-75807ae7-ada5-436a-8319-5c747ad507f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627ec732bd31425ba8c32650e76a90eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.062669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1279/2547] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:09 2022] DELETE /identity/v3/users/627ec732bd31425ba8c32650e76a90eb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:10.454817 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:10.456248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:10.486604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76c50e-f9c8-43d1-bf80-f03fb1dbb107 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:10.541692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:10.542588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:10.542899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:10.543171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] PATH_INFO: `/v3/projects/3678fd64afc54519ad1c6f5ff866e93b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:10.544610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3678fd64afc54519ad1c6f5ff866e93b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:10.546548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:10.631076 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3678fd64afc54519ad1c6f5ff866e93b', 'request_id': 'req-e7828a20-1073-4919-9459-c32c452f1b47'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.716068 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3678fd64afc54519ad1c6f5ff866e93b', 'request_id': 'req-e7828a20-1073-4919-9459-c32c452f1b47'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.720937 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:10.722247 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3678fd64afc54519ad1c6f5ff866e93b', 'request_id': 'req-e7828a20-1073-4919-9459-c32c452f1b47'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.733588 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] The token cache is being invalidate because project 3678fd64afc54519ad1c6f5ff866e93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:10.733809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.734481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e7828a20-1073-4919-9459-c32c452f1b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:10.736021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1269/2548] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:10 2022] DELETE /identity/v3/projects/3678fd64afc54519ad1c6f5ff866e93b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:10.741065 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aeeef-86ef-4fd9-9904-5fed35022f2a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:10.741544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aeeef-86ef-4fd9-9904-5fed35022f2a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:10.741644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aeeef-86ef-4fd9-9904-5fed35022f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:10.769896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-2c4aeeef-86ef-4fd9-9904-5fed35022f2a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:10.771225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-2c4aeeef-86ef-4fd9-9904-5fed35022f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:10.854479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1280/2549] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:10.862451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd9bdf-e844-4f93-a536-263c882dd382 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:10.862742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd9bdf-e844-4f93-a536-263c882dd382 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:10.863021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd9bdf-e844-4f93-a536-263c882dd382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:10.882131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-41fd9bdf-e844-4f93-a536-263c882dd382 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:10.883795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-41fd9bdf-e844-4f93-a536-263c882dd382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:10.891668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1270/2550] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:10.895675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aeeef-86ef-4fd9-9904-5fed35022f2a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:10.905364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aeeef-86ef-4fd9-9904-5fed35022f2a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:10.909899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:10.910573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:10.910846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:10.911113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:10.911821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:53:10.912121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:10.913692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:10.926354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1281/2551] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:53:10.931626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd9bdf-e844-4f93-a536-263c882dd382 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:10.940805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd9bdf-e844-4f93-a536-263c882dd382 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:10.945493 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a21c-040c-403c-bff8-6544d032ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:10.946735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a21c-040c-403c-bff8-6544d032ee95 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:10.947010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a21c-040c-403c-bff8-6544d032ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:10.947281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a21c-040c-403c-bff8-6544d032ee95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:10.947954 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887a21c-040c-403c-bff8-6544d032ee95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:10.949831 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887a21c-040c-403c-bff8-6544d032ee95 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.052012 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1271/2552] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:10 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:11.056291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:11.066252 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c6831-b933-49cb-a39c-69ac03db6a5e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:11.120818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f213c-921f-466c-a144-5693da0b0772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:11.121470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f213c-921f-466c-a144-5693da0b0772 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.121746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f213c-921f-466c-a144-5693da0b0772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.122041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f213c-921f-466c-a144-5693da0b0772 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.122711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f213c-921f-466c-a144-5693da0b0772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:11.124604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f213c-921f-466c-a144-5693da0b0772 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.189949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1282/2553] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:11 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:11.194066 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a21c-040c-403c-bff8-6544d032ee95 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:11.205005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a21c-040c-403c-bff8-6544d032ee95 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:11.209666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e616401-6d5f-4dc8-ba27-14b3db9edd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:11.210353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e616401-6d5f-4dc8-ba27-14b3db9edd57 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.210637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e616401-6d5f-4dc8-ba27-14b3db9edd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.210911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e616401-6d5f-4dc8-ba27-14b3db9edd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.212326 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e616401-6d5f-4dc8-ba27-14b3db9edd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:11.213958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e616401-6d5f-4dc8-ba27-14b3db9edd57 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.224375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1272/2554] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:11.228390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f213c-921f-466c-a144-5693da0b0772 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:11.238284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f213c-921f-466c-a144-5693da0b0772 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:11.243355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3daf3c-caab-4110-bd6a-6a39e23ed6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:11.243995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3daf3c-caab-4110-bd6a-6a39e23ed6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.244272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3daf3c-caab-4110-bd6a-6a39e23ed6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.244544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3daf3c-caab-4110-bd6a-6a39e23ed6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.245253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3daf3c-caab-4110-bd6a-6a39e23ed6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:11.247314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3daf3c-caab-4110-bd6a-6a39e23ed6a8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.257058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1283/2555] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:11.261813 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e616401-6d5f-4dc8-ba27-14b3db9edd57 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:11.271565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e616401-6d5f-4dc8-ba27-14b3db9edd57 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:11.276292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442d9b-903d-4483-a664-d8dd9d2b0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:11.277150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442d9b-903d-4483-a664-d8dd9d2b0039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.277427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442d9b-903d-4483-a664-d8dd9d2b0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.277695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442d9b-903d-4483-a664-d8dd9d2b0039 admin admin] PATH_INFO: `/v3/projects/a5945f3fcd574f36ad1c1e1ce606e01e/users/d4e75800ec474bebba6757860fcde44e/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.292257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442d9b-903d-4483-a664-d8dd9d2b0039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5945f3fcd574f36ad1c1e1ce606e01e, user_id=d4e75800ec474bebba6757860fcde44e, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:11.295184 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442d9b-903d-4483-a664-d8dd9d2b0039 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.367168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1273/2556] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:11 2022] PUT /identity/v3/projects/a5945f3fcd574f36ad1c1e1ce606e01e/users/d4e75800ec474bebba6757860fcde44e/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:11.379659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce213-d0f2-4626-a2be-248319b18988 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.379950 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce213-d0f2-4626-a2be-248319b18988 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.380229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cce213-d0f2-4626-a2be-248319b18988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.393582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:11.408109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-71cce213-d0f2-4626-a2be-248319b18988 None None] MFA Rules not processed for user `d4e75800ec474bebba6757860fcde44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:11.409458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-71cce213-d0f2-4626-a2be-248319b18988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:11.472856 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1284/2557] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:11.477627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442d9b-903d-4483-a664-d8dd9d2b0039 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:11.540618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442d9b-903d-4483-a664-d8dd9d2b0039 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:11.545639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737c9c-4316-4746-9315-0cd0df370044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:11.546320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737c9c-4316-4746-9315-0cd0df370044 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.546601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737c9c-4316-4746-9315-0cd0df370044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.546874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737c9c-4316-4746-9315-0cd0df370044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.547640 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b737c9c-4316-4746-9315-0cd0df370044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:11.549560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b737c9c-4316-4746-9315-0cd0df370044 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.654528 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1274/2558] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:11 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:11.658521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cce213-d0f2-4626-a2be-248319b18988 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:11.670264 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cce213-d0f2-4626-a2be-248319b18988 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:11.725862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88db15-0536-4c83-8c61-cfc136aeb4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:11.726544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88db15-0536-4c83-8c61-cfc136aeb4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.726825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88db15-0536-4c83-8c61-cfc136aeb4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.727774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88db15-0536-4c83-8c61-cfc136aeb4d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.728467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88db15-0536-4c83-8c61-cfc136aeb4d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:11.730412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88db15-0536-4c83-8c61-cfc136aeb4d4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.847041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1285/2559] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:11 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:11.851065 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737c9c-4316-4746-9315-0cd0df370044 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:11.861765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737c9c-4316-4746-9315-0cd0df370044 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:11.866254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478635ee-caa2-4057-8da3-843a18687eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:11.866894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478635ee-caa2-4057-8da3-843a18687eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.867174 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478635ee-caa2-4057-8da3-843a18687eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.867446 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478635ee-caa2-4057-8da3-843a18687eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.868768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478635ee-caa2-4057-8da3-843a18687eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:11.870459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478635ee-caa2-4057-8da3-843a18687eb1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.881021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1275/2560] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:11.885230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88db15-0536-4c83-8c61-cfc136aeb4d4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:11.895196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88db15-0536-4c83-8c61-cfc136aeb4d4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:11.899971 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf8da-5ee3-48ff-8103-ab7dc0f10abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:11.900869 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf8da-5ee3-48ff-8103-ab7dc0f10abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:11.901147 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf8da-5ee3-48ff-8103-ab7dc0f10abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:11.901412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf8da-5ee3-48ff-8103-ab7dc0f10abd admin admin] PATH_INFO: `/v3/projects/fa89c8d21a4f4644b27486c59bf14399/users/934399448a614f5bbd5ad3325724be86/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:11.916570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bf8da-5ee3-48ff-8103-ab7dc0f10abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa89c8d21a4f4644b27486c59bf14399, user_id=934399448a614f5bbd5ad3325724be86, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:11.919549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bf8da-5ee3-48ff-8103-ab7dc0f10abd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:11.988966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1286/2561] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:11 2022] PUT /identity/v3/projects/fa89c8d21a4f4644b27486c59bf14399/users/934399448a614f5bbd5ad3325724be86/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:11.993634 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478635ee-caa2-4057-8da3-843a18687eb1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:12.003729 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478635ee-caa2-4057-8da3-843a18687eb1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:12.060995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac5404-1adc-4714-81d0-dc1e4006dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:12.061773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5404-1adc-4714-81d0-dc1e4006dcef admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:12.061932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5404-1adc-4714-81d0-dc1e4006dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:12.062240 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5404-1adc-4714-81d0-dc1e4006dcef admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:12.062992 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5404-1adc-4714-81d0-dc1e4006dcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:12.064636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5404-1adc-4714-81d0-dc1e4006dcef admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:12.066825 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:12.075968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1276/2562] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:12.080398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf8da-5ee3-48ff-8103-ab7dc0f10abd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:12.090661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf8da-5ee3-48ff-8103-ab7dc0f10abd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:12.095260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:12.096172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:12.096449 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:12.096720 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] PATH_INFO: `/v3/projects/fa89c8d21a4f4644b27486c59bf14399/users/934399448a614f5bbd5ad3325724be86/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:12.098701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa89c8d21a4f4644b27486c59bf14399, user_id=934399448a614f5bbd5ad3325724be86, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:12.101296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:12.111741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1287/2563] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:12 2022] PUT /identity/v3/projects/fa89c8d21a4f4644b27486c59bf14399/users/934399448a614f5bbd5ad3325724be86/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:53:12.127241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea24e9-5c1f-470c-a155-70bf6b21298d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:12.127524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea24e9-5c1f-470c-a155-70bf6b21298d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:12.127799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea24e9-5c1f-470c-a155-70bf6b21298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:12.155600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-46ea24e9-5c1f-470c-a155-70bf6b21298d None None] MFA Rules not processed for user `934399448a614f5bbd5ad3325724be86`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:12.156806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46ea24e9-5c1f-470c-a155-70bf6b21298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:12.224859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1277/2564] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:12.237066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:12.238726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:12.291546 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:12.295549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a50bd-2c09-4d25-8af7-4bf04637613f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:12.299227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1733-b18f-4273-bbac-6c82281521c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:12.299861 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1733-b18f-4273-bbac-6c82281521c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:12.300143 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1733-b18f-4273-bbac-6c82281521c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:12.300417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab1733-b18f-4273-bbac-6c82281521c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:12.310298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1733-b18f-4273-bbac-6c82281521c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:12.311725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab1733-b18f-4273-bbac-6c82281521c4 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:12.321727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1288/2565] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:13.232795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea24e9-5c1f-470c-a155-70bf6b21298d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:13.241829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea24e9-5c1f-470c-a155-70bf6b21298d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:13.246463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934399448a614f5bbd5ad3325724be86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa89c8d21a4f4644b27486c59bf14399', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:13.247113 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:13.247399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:13.247674 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:13.248393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:53:13.248703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:13.250314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:13.263307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1278/2566] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:53:13.266310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1733-b18f-4273-bbac-6c82281521c4 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:13.276465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab1733-b18f-4273-bbac-6c82281521c4 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:13.281085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13695580-0bb6-4fcc-a927-b6b9f9070198 tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934399448a614f5bbd5ad3325724be86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa89c8d21a4f4644b27486c59bf14399', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:13.281727 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695580-0bb6-4fcc-a927-b6b9f9070198 tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:13.282029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695580-0bb6-4fcc-a927-b6b9f9070198 tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:13.282326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695580-0bb6-4fcc-a927-b6b9f9070198 tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:13.283019 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13695580-0bb6-4fcc-a927-b6b9f9070198 tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:13.284979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13695580-0bb6-4fcc-a927-b6b9f9070198 tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:13.379615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1289/2567] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:13 2022] POST /identity/v3/projects => generated 354 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:13.384357 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:13.394347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4232f-9976-4692-a38b-b7c5b33936fe tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:13.451945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934399448a614f5bbd5ad3325724be86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa89c8d21a4f4644b27486c59bf14399', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:13.456078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:13.456078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:13.456078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:13.456078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:53:13.456078 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:13.456546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:13.468093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1279/2568] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:53:13.503488 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13695580-0bb6-4fcc-a927-b6b9f9070198 tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:13.514865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13695580-0bb6-4fcc-a927-b6b9f9070198 tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:13.519425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934399448a614f5bbd5ad3325724be86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa89c8d21a4f4644b27486c59bf14399', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:13.520268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:13.520555 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:13.520831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] PATH_INFO: `/v3/projects/ad138cabe9dc46d3bcefc37c01c2dce5` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:13.521987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad138cabe9dc46d3bcefc37c01c2dce5)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:13.524049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:13.625292 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad138cabe9dc46d3bcefc37c01c2dce5', 'request_id': 'req-334f2bda-b28d-4f6e-94b3-c51143a534db'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:13.687330 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad138cabe9dc46d3bcefc37c01c2dce5', 'request_id': 'req-334f2bda-b28d-4f6e-94b3-c51143a534db'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:13.693217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad138cabe9dc46d3bcefc37c01c2dce5', 'request_id': 'req-334f2bda-b28d-4f6e-94b3-c51143a534db'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:13.705029 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] The token cache is being invalidate because project ad138cabe9dc46d3bcefc37c01c2dce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:13.705229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:13.705878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-334f2bda-b28d-4f6e-94b3-c51143a534db tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:13.707668 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1290/2569] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:13 2022] DELETE /identity/v3/projects/ad138cabe9dc46d3bcefc37c01c2dce5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:14.214745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:14.216500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:14.280309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7450f-b8d9-41e5-8072-e85775e120cd tempest-VolumeQuotaClassesTest-1801168137 tempest-VolumeQuotaClassesTest-1801168137-project-admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:14.288265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:14.334999 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:14.335857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:14.336160 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:14.337026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] PATH_INFO: `/v3/users/d4e75800ec474bebba6757860fcde44e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:14.338190 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e75800ec474bebba6757860fcde44e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:14.340139 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:14.522994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e75800ec474bebba6757860fcde44e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:14.593961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e75800ec474bebba6757860fcde44e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:14.597441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e75800ec474bebba6757860fcde44e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:14.598092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e75800ec474bebba6757860fcde44e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:14.610368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e75800ec474bebba6757860fcde44e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:14.616371 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1280/2570] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:14 2022] DELETE /identity/v3/users/d4e75800ec474bebba6757860fcde44e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:14.621273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaa2e-4cf1-4e31-8e3c-e379cc317232 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:14.621782 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaa2e-4cf1-4e31-8e3c-e379cc317232 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:14.621903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecaa2e-4cf1-4e31-8e3c-e379cc317232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:14.641171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3eecaa2e-4cf1-4e31-8e3c-e379cc317232 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:14.642398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3eecaa2e-4cf1-4e31-8e3c-e379cc317232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:14.700958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1291/2571] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:14.710495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:14.712576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:14.785158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d34ce-1472-48ba-a687-63760572ed1f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:14.788832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2749-22fe-4dd9-934b-f41fd61d1942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:14.789768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2749-22fe-4dd9-934b-f41fd61d1942 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:14.790081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2749-22fe-4dd9-934b-f41fd61d1942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:14.790379 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c2749-22fe-4dd9-934b-f41fd61d1942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:14.799886 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c2749-22fe-4dd9-934b-f41fd61d1942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:14.801312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c2749-22fe-4dd9-934b-f41fd61d1942 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:14.830324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1281/2572] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:15.277630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecaa2e-4cf1-4e31-8e3c-e379cc317232 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:15.279073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3eecaa2e-4cf1-4e31-8e3c-e379cc317232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:15.313987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecaa2e-4cf1-4e31-8e3c-e379cc317232 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:15.318611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:15.319463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:15.319745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:15.320019 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] PATH_INFO: `/v3/projects/a5945f3fcd574f36ad1c1e1ce606e01e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:15.321808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5945f3fcd574f36ad1c1e1ce606e01e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:15.323754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:15.389203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:15.401829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5945f3fcd574f36ad1c1e1ce606e01e', 'request_id': 'req-bb383343-98cd-437a-a39c-0e990169e678'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.464421 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5945f3fcd574f36ad1c1e1ce606e01e', 'request_id': 'req-bb383343-98cd-437a-a39c-0e990169e678'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.470363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5945f3fcd574f36ad1c1e1ce606e01e', 'request_id': 'req-bb383343-98cd-437a-a39c-0e990169e678'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.483427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] The token cache is being invalidate because project a5945f3fcd574f36ad1c1e1ce606e01e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:15.483707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.484357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.486077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1292/2573] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:15 2022] DELETE /identity/v3/projects/a5945f3fcd574f36ad1c1e1ce606e01e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:15.490154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2749-22fe-4dd9-934b-f41fd61d1942 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:15.495829 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:15.502754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c2749-22fe-4dd9-934b-f41fd61d1942 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:15.558121 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:15.558988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:15.559270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:15.559544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] PATH_INFO: `/v3/users/934399448a614f5bbd5ad3325724be86` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:15.560765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934399448a614f5bbd5ad3325724be86)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:15.562783 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:15.741569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934399448a614f5bbd5ad3325724be86'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.801231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934399448a614f5bbd5ad3325724be86'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.808329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934399448a614f5bbd5ad3325724be86'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.808955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934399448a614f5bbd5ad3325724be86'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.820595 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e8ddb8dc-5852-4cba-a9a4-1bf4fe30d382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934399448a614f5bbd5ad3325724be86'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:15.826627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1282/2574] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:15 2022] DELETE /identity/v3/users/934399448a614f5bbd5ad3325724be86 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:16.253185 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:16.254758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:16.268458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb383343-98cd-437a-a39c-0e990169e678 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:16.326865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:16.327725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:16.328006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:16.328287 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] PATH_INFO: `/v3/projects/fa89c8d21a4f4644b27486c59bf14399` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:16.329472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa89c8d21a4f4644b27486c59bf14399)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:16.331405 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:16.433092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa89c8d21a4f4644b27486c59bf14399', 'request_id': 'req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:16.491470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa89c8d21a4f4644b27486c59bf14399', 'request_id': 'req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:16.497489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa89c8d21a4f4644b27486c59bf14399', 'request_id': 'req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:16.508581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] The token cache is being invalidate because project fa89c8d21a4f4644b27486c59bf14399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:16.508875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:16.509498 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7260ef0-59f9-4e3f-ab7e-cac68a9ae698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:16.511054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1293/2575] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:16 2022] DELETE /identity/v3/projects/fa89c8d21a4f4644b27486c59bf14399 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:16.516822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151788-3744-4b76-923d-88eefbff3adc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:16.517320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151788-3744-4b76-923d-88eefbff3adc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:16.517420 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151788-3744-4b76-923d-88eefbff3adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:16.564341 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a4151788-3744-4b76-923d-88eefbff3adc None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:16.565537 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a4151788-3744-4b76-923d-88eefbff3adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:16.617298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:16.625956 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1283/2576] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:16.634089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71962ac-a943-465e-b1f7-1b94903767ee None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:16.634382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71962ac-a943-465e-b1f7-1b94903767ee None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:16.634664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71962ac-a943-465e-b1f7-1b94903767ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:16.653410 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-f71962ac-a943-465e-b1f7-1b94903767ee None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:16.654632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f71962ac-a943-465e-b1f7-1b94903767ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:16.662567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1294/2577] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:16.667178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4151788-3744-4b76-923d-88eefbff3adc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:16.677764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4151788-3744-4b76-923d-88eefbff3adc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:16.682498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:16.683317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:16.683550 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:16.683649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:16.684384 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:53:16.684686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:16.686280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:16.697678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1284/2578] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:53:16.701993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71962ac-a943-465e-b1f7-1b94903767ee None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:16.711153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71962ac-a943-465e-b1f7-1b94903767ee None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:16.716895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ca6a9-38a5-4fda-b3ee-49565ecc048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:16.717536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ca6a9-38a5-4fda-b3ee-49565ecc048d admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:16.717815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ca6a9-38a5-4fda-b3ee-49565ecc048d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:16.718120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ca6a9-38a5-4fda-b3ee-49565ecc048d admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:16.718808 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ca6a9-38a5-4fda-b3ee-49565ecc048d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:16.720695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ca6a9-38a5-4fda-b3ee-49565ecc048d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:16.808136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1295/2579] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:16 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:16.811593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:16.822136 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707970f-9f92-4db2-bac7-26a3ca7ccfd7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:16.877880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719a7c3-88ea-48ae-aeed-39a8a5295a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:16.878665 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a7c3-88ea-48ae-aeed-39a8a5295a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:16.878946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a7c3-88ea-48ae-aeed-39a8a5295a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:16.879223 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719a7c3-88ea-48ae-aeed-39a8a5295a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:16.879934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719a7c3-88ea-48ae-aeed-39a8a5295a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:16.881835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719a7c3-88ea-48ae-aeed-39a8a5295a27 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:16.994421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1285/2580] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:16 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:16.995743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ca6a9-38a5-4fda-b3ee-49565ecc048d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:17.006795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ca6a9-38a5-4fda-b3ee-49565ecc048d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:17.012836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26216c19-a856-415c-9ed3-25b2b7bd5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:17.013522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26216c19-a856-415c-9ed3-25b2b7bd5d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:17.013802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26216c19-a856-415c-9ed3-25b2b7bd5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:17.014107 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26216c19-a856-415c-9ed3-25b2b7bd5d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:17.015045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26216c19-a856-415c-9ed3-25b2b7bd5d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:17.016707 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26216c19-a856-415c-9ed3-25b2b7bd5d56 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:17.029025 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1296/2581] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:17.033229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719a7c3-88ea-48ae-aeed-39a8a5295a27 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:17.048153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719a7c3-88ea-48ae-aeed-39a8a5295a27 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:17.052946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bc433-4f9b-4e48-ae01-6b85775d3d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:17.053691 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bc433-4f9b-4e48-ae01-6b85775d3d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:17.054107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bc433-4f9b-4e48-ae01-6b85775d3d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:17.054612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bc433-4f9b-4e48-ae01-6b85775d3d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:17.056147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bc433-4f9b-4e48-ae01-6b85775d3d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:17.057762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bc433-4f9b-4e48-ae01-6b85775d3d07 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:17.069538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1286/2582] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:17.073647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26216c19-a856-415c-9ed3-25b2b7bd5d56 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:17.083956 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26216c19-a856-415c-9ed3-25b2b7bd5d56 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:17.088745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:17.089623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:17.089903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:17.090211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] PATH_INFO: `/v3/projects/2d5593d5b2b64b31b52786eb43aa8f7a/users/31e0b7991ff449f3b781f8b3c473c2c1/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:17.093357 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:17.105069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5593d5b2b64b31b52786eb43aa8f7a, user_id=31e0b7991ff449f3b781f8b3c473c2c1, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:17.107787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:17.168712 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1297/2583] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:17 2022] PUT /identity/v3/projects/2d5593d5b2b64b31b52786eb43aa8f7a/users/31e0b7991ff449f3b781f8b3c473c2c1/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:17.180939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03504-49f2-448e-95f4-b8f0fc44a9cc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:17.181353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03504-49f2-448e-95f4-b8f0fc44a9cc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:17.181635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f03504-49f2-448e-95f4-b8f0fc44a9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:17.209482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-87f03504-49f2-448e-95f4-b8f0fc44a9cc None None] MFA Rules not processed for user `31e0b7991ff449f3b781f8b3c473c2c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:17.210739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-87f03504-49f2-448e-95f4-b8f0fc44a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:17.277488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1287/2584] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:17.289447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:17.291829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:17.351688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84c66e-dd64-47a0-986b-74e1e250f13f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:17.356251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb8572-4fac-4f4d-8b90-ccaa146541ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:17.356917 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb8572-4fac-4f4d-8b90-ccaa146541ce service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:17.357197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb8572-4fac-4f4d-8b90-ccaa146541ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:17.357474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb8572-4fac-4f4d-8b90-ccaa146541ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:17.365945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb8572-4fac-4f4d-8b90-ccaa146541ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:17.367444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb8572-4fac-4f4d-8b90-ccaa146541ce service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:17.377295 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1298/2585] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:27.273825 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:27.373219 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:29.145646 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f03504-49f2-448e-95f4-b8f0fc44a9cc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:29.207394 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f03504-49f2-448e-95f4-b8f0fc44a9cc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:29.212906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:29.213762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:29.214075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:29.214351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] PATH_INFO: `/v3/users/31e0b7991ff449f3b781f8b3c473c2c1` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:29.215519 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e0b7991ff449f3b781f8b3c473c2c1)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:29.217428 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:29.443652 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e0b7991ff449f3b781f8b3c473c2c1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:29.521327 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e0b7991ff449f3b781f8b3c473c2c1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:29.529061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e0b7991ff449f3b781f8b3c473c2c1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:29.530488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e0b7991ff449f3b781f8b3c473c2c1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:29.543194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e0b7991ff449f3b781f8b3c473c2c1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:29.549701 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1288/2586] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:29 2022] DELETE /identity/v3/users/31e0b7991ff449f3b781f8b3c473c2c1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:29.554397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a9dff-9474-4450-a9e2-219bc7476272 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:29.555456 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a9dff-9474-4450-a9e2-219bc7476272 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:29.555682 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a9dff-9474-4450-a9e2-219bc7476272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:29.573314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-d59a9dff-9474-4450-a9e2-219bc7476272 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:29.574536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d59a9dff-9474-4450-a9e2-219bc7476272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:29.633250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1299/2587] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:29.643035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:29.644473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:29.723074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b4b6-0747-4848-b648-1c4882e08812 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:29.727186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba570a-38af-4e22-ade3-c0dd58456441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:29.727994 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba570a-38af-4e22-ade3-c0dd58456441 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:29.728271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba570a-38af-4e22-ade3-c0dd58456441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:29.728544 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba570a-38af-4e22-ade3-c0dd58456441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:29.737530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba570a-38af-4e22-ade3-c0dd58456441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:29.738980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba570a-38af-4e22-ade3-c0dd58456441 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:29.749251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1289/2588] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:53:30.087626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a9dff-9474-4450-a9e2-219bc7476272 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:30.089074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-d59a9dff-9474-4450-a9e2-219bc7476272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:30.101723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a9dff-9474-4450-a9e2-219bc7476272 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:30.106870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:30.107735 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.108016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.108289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] PATH_INFO: `/v3/projects/2d5593d5b2b64b31b52786eb43aa8f7a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.109517 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5593d5b2b64b31b52786eb43aa8f7a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:30.111461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:30.223216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5593d5b2b64b31b52786eb43aa8f7a', 'request_id': 'req-d8b83007-dfa5-4406-9fbc-17af406df71b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:30.296903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5593d5b2b64b31b52786eb43aa8f7a', 'request_id': 'req-d8b83007-dfa5-4406-9fbc-17af406df71b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:30.302756 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5593d5b2b64b31b52786eb43aa8f7a', 'request_id': 'req-d8b83007-dfa5-4406-9fbc-17af406df71b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:30.313937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] The token cache is being invalidate because project 2d5593d5b2b64b31b52786eb43aa8f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:30.314256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:30.314887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d8b83007-dfa5-4406-9fbc-17af406df71b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:30.316417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1300/2589] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:30 2022] DELETE /identity/v3/projects/2d5593d5b2b64b31b52786eb43aa8f7a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:30.322128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d340c-4941-4f1f-ab7c-ec16993e0439 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.322618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d340c-4941-4f1f-ab7c-ec16993e0439 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.322726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d340c-4941-4f1f-ab7c-ec16993e0439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.328961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:30.341988 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-042d340c-4941-4f1f-ab7c-ec16993e0439 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:30.345906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-042d340c-4941-4f1f-ab7c-ec16993e0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:30.402846 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1290/2590] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:30.411148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887179-5d30-4cbe-9276-a8819c230f3b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.411560 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887179-5d30-4cbe-9276-a8819c230f3b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.411846 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887179-5d30-4cbe-9276-a8819c230f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.431671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cd887179-5d30-4cbe-9276-a8819c230f3b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:30.433026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cd887179-5d30-4cbe-9276-a8819c230f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:30.441098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1301/2591] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:30.446319 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d340c-4941-4f1f-ab7c-ec16993e0439 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:30.456491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d340c-4941-4f1f-ab7c-ec16993e0439 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:30.462096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:30.465888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.465888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.465888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.465888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:53:30.465888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:30.465888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:30.478018 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1291/2592] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:53:30.482584 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887179-5d30-4cbe-9276-a8819c230f3b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:30.492076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887179-5d30-4cbe-9276-a8819c230f3b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:30.497244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff653c-7476-42a1-af25-a21ba732964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:30.498030 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff653c-7476-42a1-af25-a21ba732964f admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.500343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff653c-7476-42a1-af25-a21ba732964f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.500343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbff653c-7476-42a1-af25-a21ba732964f admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.500343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff653c-7476-42a1-af25-a21ba732964f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:30.501334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbff653c-7476-42a1-af25-a21ba732964f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:30.585002 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1302/2593] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:30 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:30.589717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:30.599760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41ae51-cc7c-45d0-bcbb-867ca7ee3a84 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:30.655238 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90af2a-50fe-4d71-8127-c6510111f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:30.655899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90af2a-50fe-4d71-8127-c6510111f174 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.656178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90af2a-50fe-4d71-8127-c6510111f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.656449 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90af2a-50fe-4d71-8127-c6510111f174 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.657133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90af2a-50fe-4d71-8127-c6510111f174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:30.659081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90af2a-50fe-4d71-8127-c6510111f174 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:30.760654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1292/2594] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:30 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:30.764666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff653c-7476-42a1-af25-a21ba732964f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:30.775863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbff653c-7476-42a1-af25-a21ba732964f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:30.780450 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5c07-5563-40ba-9b35-d46112ae9ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:30.781094 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5c07-5563-40ba-9b35-d46112ae9ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.781375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5c07-5563-40ba-9b35-d46112ae9ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.781713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5c07-5563-40ba-9b35-d46112ae9ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.782471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f5c07-5563-40ba-9b35-d46112ae9ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:30.784060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f5c07-5563-40ba-9b35-d46112ae9ebe admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:30.794825 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1303/2595] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:30.798942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90af2a-50fe-4d71-8127-c6510111f174 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:30.809565 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90af2a-50fe-4d71-8127-c6510111f174 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:30.814164 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ba236-5c5e-47c8-aa49-3c746c972109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:30.814803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba236-5c5e-47c8-aa49-3c746c972109 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.815080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba236-5c5e-47c8-aa49-3c746c972109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.815351 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba236-5c5e-47c8-aa49-3c746c972109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.816086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ba236-5c5e-47c8-aa49-3c746c972109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:30.817656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ba236-5c5e-47c8-aa49-3c746c972109 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:30.829834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1293/2596] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:30.833934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5c07-5563-40ba-9b35-d46112ae9ebe admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:30.843749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5c07-5563-40ba-9b35-d46112ae9ebe admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:30.848497 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f22af-7f08-42f2-ba5b-9e1a8b4130de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:30.849355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f22af-7f08-42f2-ba5b-9e1a8b4130de admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.849634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f22af-7f08-42f2-ba5b-9e1a8b4130de admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.849902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f22af-7f08-42f2-ba5b-9e1a8b4130de admin admin] PATH_INFO: `/v3/projects/7efd58191c65477b83c910c0b34fd8bc/users/1c1b0e669b814ae0b116663bcdbfa427/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:30.864208 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f22af-7f08-42f2-ba5b-9e1a8b4130de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efd58191c65477b83c910c0b34fd8bc, user_id=1c1b0e669b814ae0b116663bcdbfa427, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:30.866852 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f22af-7f08-42f2-ba5b-9e1a8b4130de admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:30.967857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1304/2597] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:30 2022] PUT /identity/v3/projects/7efd58191c65477b83c910c0b34fd8bc/users/1c1b0e669b814ae0b116663bcdbfa427/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:30.979098 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4300e62-1193-4df9-8395-5ca2fe3c587c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:30.979381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4300e62-1193-4df9-8395-5ca2fe3c587c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:30.979678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4300e62-1193-4df9-8395-5ca2fe3c587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.005786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b4300e62-1193-4df9-8395-5ca2fe3c587c None None] MFA Rules not processed for user `1c1b0e669b814ae0b116663bcdbfa427`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:31.007009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b4300e62-1193-4df9-8395-5ca2fe3c587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:31.073056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:31.078347 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1294/2598] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:31.082834 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f22af-7f08-42f2-ba5b-9e1a8b4130de admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:31.104569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:31.143851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f22af-7f08-42f2-ba5b-9e1a8b4130de admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:31.148463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495cca7-90d4-4af0-9793-8257284fd479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:31.149105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495cca7-90d4-4af0-9793-8257284fd479 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:31.149378 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495cca7-90d4-4af0-9793-8257284fd479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:31.149650 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495cca7-90d4-4af0-9793-8257284fd479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.150383 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495cca7-90d4-4af0-9793-8257284fd479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:31.152248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495cca7-90d4-4af0-9793-8257284fd479 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:31.225352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1305/2599] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:31 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:31.229916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4300e62-1193-4df9-8395-5ca2fe3c587c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:31.240342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4300e62-1193-4df9-8395-5ca2fe3c587c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:31.294781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b10d-401d-40bc-aee0-15216f65f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:31.295432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b10d-401d-40bc-aee0-15216f65f766 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:31.295711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b10d-401d-40bc-aee0-15216f65f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:31.295983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5b10d-401d-40bc-aee0-15216f65f766 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.296653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5b10d-401d-40bc-aee0-15216f65f766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:31.298589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5b10d-401d-40bc-aee0-15216f65f766 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:31.366230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1295/2600] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:31 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:31.371015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495cca7-90d4-4af0-9793-8257284fd479 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:31.381316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495cca7-90d4-4af0-9793-8257284fd479 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:31.386513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5efdc-d84a-4e24-b857-7e1de2061d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:31.387163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5efdc-d84a-4e24-b857-7e1de2061d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:31.387480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5efdc-d84a-4e24-b857-7e1de2061d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:31.387783 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5efdc-d84a-4e24-b857-7e1de2061d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.388499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5efdc-d84a-4e24-b857-7e1de2061d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:31.390115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5efdc-d84a-4e24-b857-7e1de2061d48 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:31.400784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1306/2601] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:31.404918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b10d-401d-40bc-aee0-15216f65f766 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:31.416639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5b10d-401d-40bc-aee0-15216f65f766 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:31.421456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c107fc9-d958-406b-8622-6da7cb6bb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:31.422363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107fc9-d958-406b-8622-6da7cb6bb2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:31.422639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107fc9-d958-406b-8622-6da7cb6bb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:31.422912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107fc9-d958-406b-8622-6da7cb6bb2b8 admin admin] PATH_INFO: `/v3/projects/96f815403b8a4be9ba30f55baeb68858/users/0c4cdd7bfa9a4527a669404d59c737c7/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.437684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c107fc9-d958-406b-8622-6da7cb6bb2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f815403b8a4be9ba30f55baeb68858, user_id=0c4cdd7bfa9a4527a669404d59c737c7, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:31.443633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c107fc9-d958-406b-8622-6da7cb6bb2b8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:31.544029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1296/2602] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:31 2022] PUT /identity/v3/projects/96f815403b8a4be9ba30f55baeb68858/users/0c4cdd7bfa9a4527a669404d59c737c7/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:53:31.548014 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5efdc-d84a-4e24-b857-7e1de2061d48 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:31.558207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5efdc-d84a-4e24-b857-7e1de2061d48 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:31.616422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d0c75-49a1-449d-996d-e3247989d45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:31.617084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d0c75-49a1-449d-996d-e3247989d45d admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:31.617265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d0c75-49a1-449d-996d-e3247989d45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:31.617535 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d0c75-49a1-449d-996d-e3247989d45d admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.618282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d0c75-49a1-449d-996d-e3247989d45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:31.620103 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d0c75-49a1-449d-996d-e3247989d45d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:31.630458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1307/2603] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:31.634336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c107fc9-d958-406b-8622-6da7cb6bb2b8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:31.644796 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c107fc9-d958-406b-8622-6da7cb6bb2b8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:31.649490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:31.650910 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:31.651170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:31.651448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] PATH_INFO: `/v3/projects/96f815403b8a4be9ba30f55baeb68858/users/0c4cdd7bfa9a4527a669404d59c737c7/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.653437 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f815403b8a4be9ba30f55baeb68858, user_id=0c4cdd7bfa9a4527a669404d59c737c7, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:31.656067 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:31.667086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1297/2604] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:31 2022] PUT /identity/v3/projects/96f815403b8a4be9ba30f55baeb68858/users/0c4cdd7bfa9a4527a669404d59c737c7/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:31.677234 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6186f-9aef-44e2-bd17-f721fa2ed9b5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:31.677522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6186f-9aef-44e2-bd17-f721fa2ed9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:31.677796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6186f-9aef-44e2-bd17-f721fa2ed9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.704963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b6f6186f-9aef-44e2-bd17-f721fa2ed9b5 None None] MFA Rules not processed for user `0c4cdd7bfa9a4527a669404d59c737c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:31.706193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b6f6186f-9aef-44e2-bd17-f721fa2ed9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:31.774362 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1308/2605] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:31.784900 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:31.786635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:31.844254 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a8137-abd2-4b4a-badf-81b391b15371 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:31.847941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d7467-996f-47eb-b9d5-6bd9f1daffe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:31.848577 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7467-996f-47eb-b9d5-6bd9f1daffe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:31.848855 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7467-996f-47eb-b9d5-6bd9f1daffe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:31.849130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d7467-996f-47eb-b9d5-6bd9f1daffe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:31.904163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7467-996f-47eb-b9d5-6bd9f1daffe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:31.905573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d7467-996f-47eb-b9d5-6bd9f1daffe4 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:31.914282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1298/2606] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:35.942171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6186f-9aef-44e2-bd17-f721fa2ed9b5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:35.959414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:36.003573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6186f-9aef-44e2-bd17-f721fa2ed9b5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:36.007961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:36.008824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:36.009098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:36.009371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] PATH_INFO: `/v3/users/1c1b0e669b814ae0b116663bcdbfa427` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:36.010702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1b0e669b814ae0b116663bcdbfa427)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:36.012673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:36.163469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1b0e669b814ae0b116663bcdbfa427'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:36.164117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1b0e669b814ae0b116663bcdbfa427'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:36.230076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1b0e669b814ae0b116663bcdbfa427'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:36.242922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1b0e669b814ae0b116663bcdbfa427'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:36.250394 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1b0e669b814ae0b116663bcdbfa427'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:36.256453 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1309/2607] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:35 2022] DELETE /identity/v3/users/1c1b0e669b814ae0b116663bcdbfa427 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:36.261491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f06ca-dd66-4aa1-b0cc-f870eae870d2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:36.262082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f06ca-dd66-4aa1-b0cc-f870eae870d2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:36.262082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f06ca-dd66-4aa1-b0cc-f870eae870d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:36.268510 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:36.280292 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6d1f06ca-dd66-4aa1-b0cc-f870eae870d2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:36.281497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d1f06ca-dd66-4aa1-b0cc-f870eae870d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:36.344742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1299/2608] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:36.354375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:36.355858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:36.413135 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ca644-91b8-4fb8-8be4-6e55455d5b0f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:36.416943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8509-225a-4318-81db-fd7089e7ec66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:36.417571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8509-225a-4318-81db-fd7089e7ec66 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:36.417845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8509-225a-4318-81db-fd7089e7ec66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:36.418155 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd8509-225a-4318-81db-fd7089e7ec66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:36.427138 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd8509-225a-4318-81db-fd7089e7ec66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:36.428747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd8509-225a-4318-81db-fd7089e7ec66 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:36.437810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1310/2609] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:53:36.870768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f06ca-dd66-4aa1-b0cc-f870eae870d2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:36.873939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d1f06ca-dd66-4aa1-b0cc-f870eae870d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:36.885786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f06ca-dd66-4aa1-b0cc-f870eae870d2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:36.890511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:36.891978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:36.892274 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:36.892722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] PATH_INFO: `/v3/projects/7efd58191c65477b83c910c0b34fd8bc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:36.893991 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7efd58191c65477b83c910c0b34fd8bc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:36.896056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:37.027635 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efd58191c65477b83c910c0b34fd8bc', 'request_id': 'req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.091176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efd58191c65477b83c910c0b34fd8bc', 'request_id': 'req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.103030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efd58191c65477b83c910c0b34fd8bc', 'request_id': 'req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.109353 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] The token cache is being invalidate because project 7efd58191c65477b83c910c0b34fd8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:37.109637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.110294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.111850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1300/2610] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:36 2022] DELETE /identity/v3/projects/7efd58191c65477b83c910c0b34fd8bc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:37.115847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8509-225a-4318-81db-fd7089e7ec66 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:37.125510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd8509-225a-4318-81db-fd7089e7ec66 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:37.159174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:37.181641 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:37.182536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:37.182815 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:37.183089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] PATH_INFO: `/v3/users/0c4cdd7bfa9a4527a669404d59c737c7` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:37.186327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4cdd7bfa9a4527a669404d59c737c7)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:37.186327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:37.368501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4cdd7bfa9a4527a669404d59c737c7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.369109 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4cdd7bfa9a4527a669404d59c737c7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.464044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4cdd7bfa9a4527a669404d59c737c7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.478121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4cdd7bfa9a4527a669404d59c737c7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.485101 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-35384955-0fe0-4721-b970-c2940733a1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4cdd7bfa9a4527a669404d59c737c7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:37.491352 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1311/2611] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:37 2022] DELETE /identity/v3/users/0c4cdd7bfa9a4527a669404d59c737c7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:37.884927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:37.886435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:37.899762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88a2ef-9c26-4ad2-9dc9-1181d566e28e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:37.961373 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:37.962227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:37.962541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:37.962815 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] PATH_INFO: `/v3/projects/96f815403b8a4be9ba30f55baeb68858` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:37.964123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f815403b8a4be9ba30f55baeb68858)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:37.966367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:38.081178 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:38.093852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f815403b8a4be9ba30f55baeb68858', 'request_id': 'req-c604018a-bd9f-4c00-89cd-6861c3f65819'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:38.166908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f815403b8a4be9ba30f55baeb68858', 'request_id': 'req-c604018a-bd9f-4c00-89cd-6861c3f65819'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:38.172993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f815403b8a4be9ba30f55baeb68858', 'request_id': 'req-c604018a-bd9f-4c00-89cd-6861c3f65819'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:38.185026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] The token cache is being invalidate because project 96f815403b8a4be9ba30f55baeb68858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:38.185354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:38.185948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c604018a-bd9f-4c00-89cd-6861c3f65819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:38.187511 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1301/2612] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:37 2022] DELETE /identity/v3/projects/96f815403b8a4be9ba30f55baeb68858 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:53:38.192703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4d6e4-b9a8-42b6-907d-f784645d5fe5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.193152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4d6e4-b9a8-42b6-907d-f784645d5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.193269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4d6e4-b9a8-42b6-907d-f784645d5fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.221979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7dd4d6e4-b9a8-42b6-907d-f784645d5fe5 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:38.223197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7dd4d6e4-b9a8-42b6-907d-f784645d5fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:38.281341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1312/2613] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:38.289049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bfab-b0a3-4d77-8315-6207c95b5d18 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.289337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bfab-b0a3-4d77-8315-6207c95b5d18 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.289609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817bfab-b0a3-4d77-8315-6207c95b5d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.309461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4817bfab-b0a3-4d77-8315-6207c95b5d18 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:38.310697 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4817bfab-b0a3-4d77-8315-6207c95b5d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:38.318393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1302/2614] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:38.322683 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4d6e4-b9a8-42b6-907d-f784645d5fe5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:38.332082 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4d6e4-b9a8-42b6-907d-f784645d5fe5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:38.336576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:38.337743 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.338115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.338479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.339193 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:53:38.339494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:38.341084 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:38.352342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1313/2615] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:53:38.357192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817bfab-b0a3-4d77-8315-6207c95b5d18 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:38.366177 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817bfab-b0a3-4d77-8315-6207c95b5d18 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:38.370911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e10534-2c23-4460-b763-f5b741b04102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:38.371540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e10534-2c23-4460-b763-f5b741b04102 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.371816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e10534-2c23-4460-b763-f5b741b04102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.372086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e10534-2c23-4460-b763-f5b741b04102 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.372791 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e10534-2c23-4460-b763-f5b741b04102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:38.374682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e10534-2c23-4460-b763-f5b741b04102 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:38.483880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1303/2616] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:38 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:53:38.487944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:38.498071 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd09e4-2b3d-4b02-bc40-766ca229d907 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:38.530583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:38.557576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7257c60-3ea0-4ac1-ae3a-691be552f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:38.558947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7257c60-3ea0-4ac1-ae3a-691be552f56a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.559233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7257c60-3ea0-4ac1-ae3a-691be552f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.559688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7257c60-3ea0-4ac1-ae3a-691be552f56a admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.560388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7257c60-3ea0-4ac1-ae3a-691be552f56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:38.562333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7257c60-3ea0-4ac1-ae3a-691be552f56a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:38.664443 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1314/2617] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:38 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:38.668918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e10534-2c23-4460-b763-f5b741b04102 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:38.679605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e10534-2c23-4460-b763-f5b741b04102 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:38.684781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e62d1-199c-4976-8cff-337199ba31c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:38.685551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e62d1-199c-4976-8cff-337199ba31c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.685952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e62d1-199c-4976-8cff-337199ba31c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.686328 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e62d1-199c-4976-8cff-337199ba31c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.687124 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e62d1-199c-4976-8cff-337199ba31c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:38.688870 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e62d1-199c-4976-8cff-337199ba31c9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:38.703853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1304/2618] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:53:38.705311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7257c60-3ea0-4ac1-ae3a-691be552f56a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:38.717274 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7257c60-3ea0-4ac1-ae3a-691be552f56a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:38.721970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d8d6b-5095-4a54-b111-757ec901eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:38.724431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d8d6b-5095-4a54-b111-757ec901eef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.724431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d8d6b-5095-4a54-b111-757ec901eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.724431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d8d6b-5095-4a54-b111-757ec901eef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.724431 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d8d6b-5095-4a54-b111-757ec901eef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:38.725477 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d8d6b-5095-4a54-b111-757ec901eef1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:38.735910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1315/2619] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:38.740061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e62d1-199c-4976-8cff-337199ba31c9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:38.754391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e62d1-199c-4976-8cff-337199ba31c9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:38.754527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:38.755349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.755623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.755895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] PATH_INFO: `/v3/projects/930523c154af4e5380c7a42f72572974/users/fdd44dbae445494ba904a78704a49e99/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.771273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930523c154af4e5380c7a42f72572974, user_id=fdd44dbae445494ba904a78704a49e99, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:38.773879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:38.864168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1305/2620] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:38 2022] PUT /identity/v3/projects/930523c154af4e5380c7a42f72572974/users/fdd44dbae445494ba904a78704a49e99/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:38.876048 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c9388-f658-4a3f-8fdd-76b1fa0a6d70 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:38.876368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c9388-f658-4a3f-8fdd-76b1fa0a6d70 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:38.876647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c9388-f658-4a3f-8fdd-76b1fa0a6d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:38.902814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-916c9388-f658-4a3f-8fdd-76b1fa0a6d70 None None] MFA Rules not processed for user `fdd44dbae445494ba904a78704a49e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:38.904519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-916c9388-f658-4a3f-8fdd-76b1fa0a6d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:38.970319 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1316/2621] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:38.981441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:38.983226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:39.039445 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ed0d5-2859-4743-87da-b100bf263683 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:39.044057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e974f-6c3b-44dc-b0b8-59fa4a7e1a4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:39.044711 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e974f-6c3b-44dc-b0b8-59fa4a7e1a4a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:39.044993 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e974f-6c3b-44dc-b0b8-59fa4a7e1a4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:39.045272 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e974f-6c3b-44dc-b0b8-59fa4a7e1a4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:39.053941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e974f-6c3b-44dc-b0b8-59fa4a7e1a4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:39.055407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e974f-6c3b-44dc-b0b8-59fa4a7e1a4a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:39.064753 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1306/2622] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:43.055970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c9388-f658-4a3f-8fdd-76b1fa0a6d70 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:43.117936 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c9388-f658-4a3f-8fdd-76b1fa0a6d70 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:43.122497 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:43.123359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:43.123635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:43.123903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] PATH_INFO: `/v3/users/fdd44dbae445494ba904a78704a49e99` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:43.125068 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd44dbae445494ba904a78704a49e99)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:43.127023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:43.276442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:43.277889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd44dbae445494ba904a78704a49e99'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:43.278631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd44dbae445494ba904a78704a49e99'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:43.360734 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd44dbae445494ba904a78704a49e99'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:43.373526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd44dbae445494ba904a78704a49e99'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:43.380307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd44dbae445494ba904a78704a49e99'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:43.386829 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1317/2623] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:43 2022] DELETE /identity/v3/users/fdd44dbae445494ba904a78704a49e99 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:43.391372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55adc6-713d-4064-b6b0-f6e880ad5f02 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:43.391840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55adc6-713d-4064-b6b0-f6e880ad5f02 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:43.391964 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55adc6-713d-4064-b6b0-f6e880ad5f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:43.410388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7f55adc6-713d-4064-b6b0-f6e880ad5f02 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:43.411607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7f55adc6-713d-4064-b6b0-f6e880ad5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:43.464671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:43.497243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1307/2624] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:43.497913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:43.497913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:43.544500 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73796f6-1ba1-416f-bdb0-d353ef6a6668 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:43.548112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27ab71-9375-4371-b325-191955d0e9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:43.548757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27ab71-9375-4371-b325-191955d0e9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:43.549036 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27ab71-9375-4371-b325-191955d0e9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:43.549709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27ab71-9375-4371-b325-191955d0e9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:43.560296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27ab71-9375-4371-b325-191955d0e9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:43.561740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27ab71-9375-4371-b325-191955d0e9e2 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:43.573024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1318/2625] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:44.028944 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55adc6-713d-4064-b6b0-f6e880ad5f02 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:44.030526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7f55adc6-713d-4064-b6b0-f6e880ad5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:44.044600 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55adc6-713d-4064-b6b0-f6e880ad5f02 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:44.053874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:44.053874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:44.053874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:44.053874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] PATH_INFO: `/v3/projects/930523c154af4e5380c7a42f72572974` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:44.060586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=930523c154af4e5380c7a42f72572974)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:44.060586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:44.140194 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930523c154af4e5380c7a42f72572974', 'request_id': 'req-3341728c-5455-4e63-8924-7c844164a2ab'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:44.212801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930523c154af4e5380c7a42f72572974', 'request_id': 'req-3341728c-5455-4e63-8924-7c844164a2ab'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:44.220381 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930523c154af4e5380c7a42f72572974', 'request_id': 'req-3341728c-5455-4e63-8924-7c844164a2ab'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:44.232609 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] The token cache is being invalidate because project 930523c154af4e5380c7a42f72572974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:44.232894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:44.233624 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:44.235245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1308/2626] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:44 2022] DELETE /identity/v3/projects/930523c154af4e5380c7a42f72572974 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:53:52.780713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27ab71-9375-4371-b325-191955d0e9e2 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:52.789342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27ab71-9375-4371-b325-191955d0e9e2 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:52.839414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:52.839975 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:52.840250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:52.840520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:52.842367 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:52.903455 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:52.904871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:52.914321 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1319/2627] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:54.229364 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:56.374660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:56.382334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:56.396408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341728c-5455-4e63-8924-7c844164a2ab admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:56.401786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:56.402722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:56.403004 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:56.403280 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] PATH_INFO: `/v3/users/2ffacb9e00b8448eb56a233a5d564d0e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:56.417369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffacb9e00b8448eb56a233a5d564d0e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:56.419589 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:56.585264 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffacb9e00b8448eb56a233a5d564d0e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:56.635482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffacb9e00b8448eb56a233a5d564d0e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:56.644054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffacb9e00b8448eb56a233a5d564d0e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:56.644717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffacb9e00b8448eb56a233a5d564d0e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:56.658035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-dd5c6cb7-70d4-4c3b-82bf-22c49f192d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffacb9e00b8448eb56a233a5d564d0e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:56.664175 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1309/2628] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:56 2022] DELETE /identity/v3/users/2ffacb9e00b8448eb56a233a5d564d0e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:53:56.893709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:56.904951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1cb27-d2e9-449a-b196-4ff1e1546353 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:56.919398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:56.965176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:56.966078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:56.966360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:56.966632 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] PATH_INFO: `/v3/projects/3a7373826e4743088ff1d782782b9890` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:56.977060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7373826e4743088ff1d782782b9890)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:56.979787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:57.105991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7373826e4743088ff1d782782b9890', 'request_id': 'req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:57.178054 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7373826e4743088ff1d782782b9890', 'request_id': 'req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:57.184765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7373826e4743088ff1d782782b9890', 'request_id': 'req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:57.196364 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] The token cache is being invalidate because project 3a7373826e4743088ff1d782782b9890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:53:57.196646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:57.197273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8cedca1c-73aa-427b-b2d8-3dd7fad776d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:57.198897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1320/2629] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:56 2022] DELETE /identity/v3/projects/3a7373826e4743088ff1d782782b9890 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:57.203883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894cd4-1a34-4e8f-9b13-08e80aa59c75 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.204246 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894cd4-1a34-4e8f-9b13-08e80aa59c75 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.204534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11894cd4-1a34-4e8f-9b13-08e80aa59c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.222862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-11894cd4-1a34-4e8f-9b13-08e80aa59c75 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:57.224054 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-11894cd4-1a34-4e8f-9b13-08e80aa59c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:57.282495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1310/2630] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:57.290286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50efa-f0ef-4b56-893d-cc45dc83fa7a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.290572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50efa-f0ef-4b56-893d-cc45dc83fa7a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.290849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50efa-f0ef-4b56-893d-cc45dc83fa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.309920 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-21f50efa-f0ef-4b56-893d-cc45dc83fa7a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:57.311172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-21f50efa-f0ef-4b56-893d-cc45dc83fa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:57.319170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1321/2631] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:57.323442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894cd4-1a34-4e8f-9b13-08e80aa59c75 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:57.332878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11894cd4-1a34-4e8f-9b13-08e80aa59c75 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:57.337401 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:57.338759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.339029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.339299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.340040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:53:57.340389 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:57.341968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:57.353202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1311/2632] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:53:57.357955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f50efa-f0ef-4b56-893d-cc45dc83fa7a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:57.367190 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f50efa-f0ef-4b56-893d-cc45dc83fa7a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:57.372096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fba655-d187-44f9-b9a7-b477cd1a2fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:57.372740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba655-d187-44f9-b9a7-b477cd1a2fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.373022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba655-d187-44f9-b9a7-b477cd1a2fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.373299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba655-d187-44f9-b9a7-b477cd1a2fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.373981 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fba655-d187-44f9-b9a7-b477cd1a2fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:57.375921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fba655-d187-44f9-b9a7-b477cd1a2fb5 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:57.470142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1322/2633] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:57 2022] POST /identity/v3/projects => generated 405 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:57.474407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:57.484935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c622d4-c9af-458f-8c6a-4de4dceea1ff admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:57.528366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:57.539850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddf3a7-db82-472d-ac41-ac308813ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:57.540504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddf3a7-db82-472d-ac41-ac308813ae6d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.540781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddf3a7-db82-472d-ac41-ac308813ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.541696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddf3a7-db82-472d-ac41-ac308813ae6d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.542546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddf3a7-db82-472d-ac41-ac308813ae6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:57.544678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddf3a7-db82-472d-ac41-ac308813ae6d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:57.645601 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1312/2634] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:57 2022] POST /identity/v3/users => generated 303 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:53:57.649698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fba655-d187-44f9-b9a7-b477cd1a2fb5 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:57.660061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fba655-d187-44f9-b9a7-b477cd1a2fb5 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:57.664626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a96ab9-eb80-43a8-9017-aeb6f28a63e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:57.665266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96ab9-eb80-43a8-9017-aeb6f28a63e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.665544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96ab9-eb80-43a8-9017-aeb6f28a63e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.665813 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a96ab9-eb80-43a8-9017-aeb6f28a63e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.666694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a96ab9-eb80-43a8-9017-aeb6f28a63e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:57.668534 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a96ab9-eb80-43a8-9017-aeb6f28a63e1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:57.678315 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1323/2635] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:57.683033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddf3a7-db82-472d-ac41-ac308813ae6d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:57.693421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddf3a7-db82-472d-ac41-ac308813ae6d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:57.699797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce7366-29a0-44be-8a75-aa4bf35701b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:57.700441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7366-29a0-44be-8a75-aa4bf35701b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.700725 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7366-29a0-44be-8a75-aa4bf35701b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.701003 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7366-29a0-44be-8a75-aa4bf35701b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.701746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce7366-29a0-44be-8a75-aa4bf35701b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:57.703396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce7366-29a0-44be-8a75-aa4bf35701b5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:57.714655 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1313/2636] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:57.718807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a96ab9-eb80-43a8-9017-aeb6f28a63e1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:57.729583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a96ab9-eb80-43a8-9017-aeb6f28a63e1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:57.734211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283802e4-0fc6-4194-8aa8-b38850bbf69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:57.735070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283802e4-0fc6-4194-8aa8-b38850bbf69d admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.735458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283802e4-0fc6-4194-8aa8-b38850bbf69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.735736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283802e4-0fc6-4194-8aa8-b38850bbf69d admin admin] PATH_INFO: `/v3/projects/ad79394ef6644647b56c7e42a9660fdd/users/44874a263806436c87ef1222c687c73e/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.750240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283802e4-0fc6-4194-8aa8-b38850bbf69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad79394ef6644647b56c7e42a9660fdd, user_id=44874a263806436c87ef1222c687c73e, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:57.752854 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283802e4-0fc6-4194-8aa8-b38850bbf69d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:57.821725 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1324/2637] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:57 2022] PUT /identity/v3/projects/ad79394ef6644647b56c7e42a9660fdd/users/44874a263806436c87ef1222c687c73e/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:57.837407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ede3-05fa-4e7d-8d64-333cf32d9285 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:57.837710 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ede3-05fa-4e7d-8d64-333cf32d9285 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:57.838717 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8ede3-05fa-4e7d-8d64-333cf32d9285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:57.865268 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ada8ede3-05fa-4e7d-8d64-333cf32d9285 None None] MFA Rules not processed for user `44874a263806436c87ef1222c687c73e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:57.866514 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ada8ede3-05fa-4e7d-8d64-333cf32d9285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:57.932765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1314/2638] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:53:57.937188 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283802e4-0fc6-4194-8aa8-b38850bbf69d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:57.972078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:57.998969 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283802e4-0fc6-4194-8aa8-b38850bbf69d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:58.003658 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d436fd9-ff86-4408-97f5-0ae3cc990efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:58.004318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d436fd9-ff86-4408-97f5-0ae3cc990efe admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:58.004640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d436fd9-ff86-4408-97f5-0ae3cc990efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:58.004935 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d436fd9-ff86-4408-97f5-0ae3cc990efe admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:58.005637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d436fd9-ff86-4408-97f5-0ae3cc990efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:58.007583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d436fd9-ff86-4408-97f5-0ae3cc990efe admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:58.100176 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1325/2639] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:53:57 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:53:58.104957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8ede3-05fa-4e7d-8d64-333cf32d9285 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:58.115960 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8ede3-05fa-4e7d-8d64-333cf32d9285 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:58.175569 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c6bd-4848-4bd9-ab4b-7587369e1d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:58.176227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c6bd-4848-4bd9-ab4b-7587369e1d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:58.176552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c6bd-4848-4bd9-ab4b-7587369e1d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:58.176828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c6bd-4848-4bd9-ab4b-7587369e1d7f admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:58.177506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04c6bd-4848-4bd9-ab4b-7587369e1d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:58.179436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04c6bd-4848-4bd9-ab4b-7587369e1d7f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:58.258057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1315/2640] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:53:58 2022] POST /identity/v3/users => generated 308 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:53:58.262407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d436fd9-ff86-4408-97f5-0ae3cc990efe admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:58.272849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d436fd9-ff86-4408-97f5-0ae3cc990efe admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:58.278282 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a432262-a0ea-4525-9fa2-ea78ca5b144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:58.278923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a432262-a0ea-4525-9fa2-ea78ca5b144a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:58.279197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a432262-a0ea-4525-9fa2-ea78ca5b144a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:58.279466 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a432262-a0ea-4525-9fa2-ea78ca5b144a admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:58.280178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a432262-a0ea-4525-9fa2-ea78ca5b144a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:58.281755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a432262-a0ea-4525-9fa2-ea78ca5b144a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:58.292730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1326/2641] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:58.297111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c6bd-4848-4bd9-ab4b-7587369e1d7f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:58.307331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c6bd-4848-4bd9-ab4b-7587369e1d7f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:58.311885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a653c66-0642-4939-8796-c1437df3e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:58.312747 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a653c66-0642-4939-8796-c1437df3e9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:58.313027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a653c66-0642-4939-8796-c1437df3e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:58.313298 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a653c66-0642-4939-8796-c1437df3e9b3 admin admin] PATH_INFO: `/v3/projects/315f811e894c4729863fb4357b8478b9/users/28ec7f0d73e74f50934bd3a4f19b93bf/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:58.328390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a653c66-0642-4939-8796-c1437df3e9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=315f811e894c4729863fb4357b8478b9, user_id=28ec7f0d73e74f50934bd3a4f19b93bf, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:58.331120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a653c66-0642-4939-8796-c1437df3e9b3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:58.446452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1316/2642] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:58 2022] PUT /identity/v3/projects/315f811e894c4729863fb4357b8478b9/users/28ec7f0d73e74f50934bd3a4f19b93bf/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:58.451124 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a432262-a0ea-4525-9fa2-ea78ca5b144a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:58.461350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a432262-a0ea-4525-9fa2-ea78ca5b144a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:58.517660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d4f33-fc1d-47e7-bcbd-8f2872a9a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:58.518311 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4f33-fc1d-47e7-bcbd-8f2872a9a6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:58.518596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4f33-fc1d-47e7-bcbd-8f2872a9a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:58.518867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d4f33-fc1d-47e7-bcbd-8f2872a9a6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:58.519582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4f33-fc1d-47e7-bcbd-8f2872a9a6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:58.521165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d4f33-fc1d-47e7-bcbd-8f2872a9a6b6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:58.531847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1327/2643] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:53:58.535940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a653c66-0642-4939-8796-c1437df3e9b3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:58.546271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a653c66-0642-4939-8796-c1437df3e9b3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:58.551117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:58.551989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:58.552267 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:58.552540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] PATH_INFO: `/v3/projects/315f811e894c4729863fb4357b8478b9/users/28ec7f0d73e74f50934bd3a4f19b93bf/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:58.554615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=315f811e894c4729863fb4357b8478b9, user_id=28ec7f0d73e74f50934bd3a4f19b93bf, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:58.557344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:58.567785 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1317/2644] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:53:58 2022] PUT /identity/v3/projects/315f811e894c4729863fb4357b8478b9/users/28ec7f0d73e74f50934bd3a4f19b93bf/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:53:58.579842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853d85-3dd9-46e9-aa86-d53ccaef382c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:58.580134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853d85-3dd9-46e9-aa86-d53ccaef382c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:58.580406 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853d85-3dd9-46e9-aa86-d53ccaef382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:58.607463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b8853d85-3dd9-46e9-aa86-d53ccaef382c None None] MFA Rules not processed for user `28ec7f0d73e74f50934bd3a4f19b93bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:58.608674 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b8853d85-3dd9-46e9-aa86-d53ccaef382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:58.675115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1328/2645] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:53:58.686225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:58.687887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:58.701530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:58.767899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb756a-d141-4339-b503-89f8aba6f4bc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:58.771693 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac79318-158d-4345-94dc-b386aafedc1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:58.772329 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79318-158d-4345-94dc-b386aafedc1d service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:58.772610 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79318-158d-4345-94dc-b386aafedc1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:58.772885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79318-158d-4345-94dc-b386aafedc1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:58.782433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79318-158d-4345-94dc-b386aafedc1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:58.783838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79318-158d-4345-94dc-b386aafedc1d service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:58.794363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1318/2646] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:53:58.934798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8853d85-3dd9-46e9-aa86-d53ccaef382c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:58.965171 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:58.995690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8853d85-3dd9-46e9-aa86-d53ccaef382c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:59.000771 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:59.001623 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:59.001897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:59.002195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] PATH_INFO: `/v3/users/44874a263806436c87ef1222c687c73e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:59.003356 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44874a263806436c87ef1222c687c73e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:59.005268 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:59.183965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44874a263806436c87ef1222c687c73e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:59.184625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44874a263806436c87ef1222c687c73e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:59.256158 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44874a263806436c87ef1222c687c73e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:59.268851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44874a263806436c87ef1222c687c73e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:59.275966 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44874a263806436c87ef1222c687c73e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:53:59.282038 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1329/2647] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:53:58 2022] DELETE /identity/v3/users/44874a263806436c87ef1222c687c73e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:53:59.286407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc16d63-00da-4113-ab1d-2727e81a342e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:59.286781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc16d63-00da-4113-ab1d-2727e81a342e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:59.287192 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc16d63-00da-4113-ab1d-2727e81a342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:59.304678 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bbc16d63-00da-4113-ab1d-2727e81a342e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:53:59.308893 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bbc16d63-00da-4113-ab1d-2727e81a342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:59.364321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1319/2648] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:53:59.374373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:59.382425 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:59.434604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982b1dd-9b2d-4d5f-b5ec-3b2c2b5e6163 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:59.438244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141905e-b8f6-49b9-a818-256287187332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:59.438887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141905e-b8f6-49b9-a818-256287187332 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:59.439165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141905e-b8f6-49b9-a818-256287187332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:59.439452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141905e-b8f6-49b9-a818-256287187332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:59.448958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141905e-b8f6-49b9-a818-256287187332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:59.450427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141905e-b8f6-49b9-a818-256287187332 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:53:59.459792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1330/2649] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:53:59.894048 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc16d63-00da-4113-ab1d-2727e81a342e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:53:59.903407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bbc16d63-00da-4113-ab1d-2727e81a342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:53:59.908034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc16d63-00da-4113-ab1d-2727e81a342e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:53:59.912837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:53:59.915163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:53:59.915400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:53:59.915681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] PATH_INFO: `/v3/projects/ad79394ef6644647b56c7e42a9660fdd` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:53:59.917702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad79394ef6644647b56c7e42a9660fdd)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:53:59.919906 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:00.024349 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad79394ef6644647b56c7e42a9660fdd', 'request_id': 'req-a01335e5-109c-4c3e-9de7-940cf49e6fbb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.103337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad79394ef6644647b56c7e42a9660fdd', 'request_id': 'req-a01335e5-109c-4c3e-9de7-940cf49e6fbb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.110241 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad79394ef6644647b56c7e42a9660fdd', 'request_id': 'req-a01335e5-109c-4c3e-9de7-940cf49e6fbb'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.121762 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] The token cache is being invalidate because project ad79394ef6644647b56c7e42a9660fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:00.122074 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.122709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.124248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1320/2650] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:53:59 2022] DELETE /identity/v3/projects/ad79394ef6644647b56c7e42a9660fdd => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:00.128191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141905e-b8f6-49b9-a818-256287187332 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:00.138695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141905e-b8f6-49b9-a818-256287187332 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:00.184620 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:00.194056 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:00.194923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:00.195201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:00.195473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] PATH_INFO: `/v3/users/28ec7f0d73e74f50934bd3a4f19b93bf` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:00.196651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ec7f0d73e74f50934bd3a4f19b93bf)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:00.199222 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:00.368070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ec7f0d73e74f50934bd3a4f19b93bf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.368749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ec7f0d73e74f50934bd3a4f19b93bf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.440658 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ec7f0d73e74f50934bd3a4f19b93bf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.454207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ec7f0d73e74f50934bd3a4f19b93bf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.461092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-27370424-7a31-4d53-bb86-f5d2e8e41a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ec7f0d73e74f50934bd3a4f19b93bf'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:00.467687 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1331/2651] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:00 2022] DELETE /identity/v3/users/28ec7f0d73e74f50934bd3a4f19b93bf => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:00.899154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:00.900644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:00.913868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01335e5-109c-4c3e-9de7-940cf49e6fbb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:00.927227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:00.972679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:00.973472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:00.973757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:00.974083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] PATH_INFO: `/v3/projects/315f811e894c4729863fb4357b8478b9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:00.975302 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=315f811e894c4729863fb4357b8478b9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:00.977203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:01.093097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315f811e894c4729863fb4357b8478b9', 'request_id': 'req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:01.166793 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315f811e894c4729863fb4357b8478b9', 'request_id': 'req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:01.173031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315f811e894c4729863fb4357b8478b9', 'request_id': 'req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:01.184026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] The token cache is being invalidate because project 315f811e894c4729863fb4357b8478b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:01.184301 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:01.188135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f6cc32f0-14eb-4a4c-ab0f-9316a1257a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:01.188135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1321/2652] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:00 2022] DELETE /identity/v3/projects/315f811e894c4729863fb4357b8478b9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:01.191415 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b139e1a-66d1-4884-8ed8-a5e7d7800be3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.191892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b139e1a-66d1-4884-8ed8-a5e7d7800be3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.192006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b139e1a-66d1-4884-8ed8-a5e7d7800be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.209327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0b139e1a-66d1-4884-8ed8-a5e7d7800be3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:01.210531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0b139e1a-66d1-4884-8ed8-a5e7d7800be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:01.269180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1332/2653] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:01.277195 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046eb7-994c-4775-8835-cf37eb844ef0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.277482 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046eb7-994c-4775-8835-cf37eb844ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.277759 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046eb7-994c-4775-8835-cf37eb844ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.297007 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8f046eb7-994c-4775-8835-cf37eb844ef0 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:01.298169 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8f046eb7-994c-4775-8835-cf37eb844ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:01.305905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1322/2654] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:01.310285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b139e1a-66d1-4884-8ed8-a5e7d7800be3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:01.319886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b139e1a-66d1-4884-8ed8-a5e7d7800be3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:01.324738 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:01.325400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.325660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.325934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.326680 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:54:01.326984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:01.328575 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:01.340529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1333/2655] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:54:01.344724 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f046eb7-994c-4775-8835-cf37eb844ef0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:01.355473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f046eb7-994c-4775-8835-cf37eb844ef0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:01.360129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd14f5a-0151-4311-8c99-22fe004d1532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:01.360765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd14f5a-0151-4311-8c99-22fe004d1532 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.361047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd14f5a-0151-4311-8c99-22fe004d1532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.361321 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd14f5a-0151-4311-8c99-22fe004d1532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.362030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd14f5a-0151-4311-8c99-22fe004d1532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:01.363911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd14f5a-0151-4311-8c99-22fe004d1532 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:01.436487 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1323/2656] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:54:01 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:54:01.440733 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:01.452196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028f0c-a9d0-4c02-a03c-5f5e10acb1ac admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:01.502842 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:01.508493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3736-d625-43aa-b093-480d0afd80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:01.509151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3736-d625-43aa-b093-480d0afd80ec admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.509434 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3736-d625-43aa-b093-480d0afd80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.509709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3736-d625-43aa-b093-480d0afd80ec admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.511420 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a3736-d625-43aa-b093-480d0afd80ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:01.513325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a3736-d625-43aa-b093-480d0afd80ec admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:01.606194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1334/2657] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:54:01 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:01.610470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd14f5a-0151-4311-8c99-22fe004d1532 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:01.620685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd14f5a-0151-4311-8c99-22fe004d1532 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:01.625196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75bbb-900e-4256-9118-3dd38255f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:01.625838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75bbb-900e-4256-9118-3dd38255f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.626144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75bbb-900e-4256-9118-3dd38255f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.626423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e75bbb-900e-4256-9118-3dd38255f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.627137 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e75bbb-900e-4256-9118-3dd38255f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:01.631809 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e75bbb-900e-4256-9118-3dd38255f4c8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:01.639378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1324/2658] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:01.643331 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3736-d625-43aa-b093-480d0afd80ec admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:01.655012 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3736-d625-43aa-b093-480d0afd80ec admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:01.659765 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8b875-0c14-42ea-acff-a302816812a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:01.660603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b875-0c14-42ea-acff-a302816812a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.660897 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b875-0c14-42ea-acff-a302816812a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.661169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8b875-0c14-42ea-acff-a302816812a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.661886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8b875-0c14-42ea-acff-a302816812a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:01.663502 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8b875-0c14-42ea-acff-a302816812a6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:01.674526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1335/2659] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:01.678552 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75bbb-900e-4256-9118-3dd38255f4c8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:01.688259 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e75bbb-900e-4256-9118-3dd38255f4c8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:01.692795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7626a-6fa5-4d43-9b51-9e32143b968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:01.693682 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7626a-6fa5-4d43-9b51-9e32143b968f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.693959 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7626a-6fa5-4d43-9b51-9e32143b968f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.694261 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7626a-6fa5-4d43-9b51-9e32143b968f admin admin] PATH_INFO: `/v3/projects/a9878e2b8d81462dba36f1426a6955da/users/1e50bd9538ef4756b6340108ed01cce8/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.708879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7626a-6fa5-4d43-9b51-9e32143b968f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9878e2b8d81462dba36f1426a6955da, user_id=1e50bd9538ef4756b6340108ed01cce8, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:01.711570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7626a-6fa5-4d43-9b51-9e32143b968f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:01.766269 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1325/2660] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:01 2022] PUT /identity/v3/projects/a9878e2b8d81462dba36f1426a6955da/users/1e50bd9538ef4756b6340108ed01cce8/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:01.778372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e97534-6c01-4e3b-8ada-117850a9775b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.789904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e97534-6c01-4e3b-8ada-117850a9775b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.789904 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e97534-6c01-4e3b-8ada-117850a9775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.805510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-31e97534-6c01-4e3b-8ada-117850a9775b None None] MFA Rules not processed for user `1e50bd9538ef4756b6340108ed01cce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:01.806740 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-31e97534-6c01-4e3b-8ada-117850a9775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:01.872528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1336/2661] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:01.877002 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7626a-6fa5-4d43-9b51-9e32143b968f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:01.924704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:01.942851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7626a-6fa5-4d43-9b51-9e32143b968f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:01.948276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab05ca-8f2f-49b8-8ffe-4a6ea9f5944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:01.948932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab05ca-8f2f-49b8-8ffe-4a6ea9f5944d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:01.949218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab05ca-8f2f-49b8-8ffe-4a6ea9f5944d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:01.949490 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab05ca-8f2f-49b8-8ffe-4a6ea9f5944d admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:01.950211 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab05ca-8f2f-49b8-8ffe-4a6ea9f5944d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:01.952135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab05ca-8f2f-49b8-8ffe-4a6ea9f5944d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:02.019058 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1326/2662] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:54:01 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:02.023107 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e97534-6c01-4e3b-8ada-117850a9775b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:02.034164 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e97534-6c01-4e3b-8ada-117850a9775b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:02.091785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b360-4834-4058-9eb7-91d2babffa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:02.092446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b360-4834-4058-9eb7-91d2babffa9e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:02.092723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b360-4834-4058-9eb7-91d2babffa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:02.092995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b360-4834-4058-9eb7-91d2babffa9e admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:02.093709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5b360-4834-4058-9eb7-91d2babffa9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:02.095866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5b360-4834-4058-9eb7-91d2babffa9e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:02.160298 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1337/2663] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:54:02 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:54:02.164415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab05ca-8f2f-49b8-8ffe-4a6ea9f5944d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:02.175604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab05ca-8f2f-49b8-8ffe-4a6ea9f5944d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:02.180421 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072d31e-133d-4335-90b6-fa0e025e16aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:02.181067 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072d31e-133d-4335-90b6-fa0e025e16aa admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:02.181344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072d31e-133d-4335-90b6-fa0e025e16aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:02.181617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072d31e-133d-4335-90b6-fa0e025e16aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:02.182955 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072d31e-133d-4335-90b6-fa0e025e16aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:02.184608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072d31e-133d-4335-90b6-fa0e025e16aa admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:02.195149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1327/2664] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:02.199446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b360-4834-4058-9eb7-91d2babffa9e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:02.209243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b360-4834-4058-9eb7-91d2babffa9e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:02.214122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35c68-9735-4e1b-9dfe-c3740a1b134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:02.214993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35c68-9735-4e1b-9dfe-c3740a1b134a admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:02.215270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35c68-9735-4e1b-9dfe-c3740a1b134a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:02.215539 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b35c68-9735-4e1b-9dfe-c3740a1b134a admin admin] PATH_INFO: `/v3/projects/24c65b7a75e24fc6b981f2cfa503442b/users/13c2b2528e8e47dda63960ec1d302b60/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:02.230655 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35c68-9735-4e1b-9dfe-c3740a1b134a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c65b7a75e24fc6b981f2cfa503442b, user_id=13c2b2528e8e47dda63960ec1d302b60, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:02.233273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b35c68-9735-4e1b-9dfe-c3740a1b134a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:02.301824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1338/2665] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:02 2022] PUT /identity/v3/projects/24c65b7a75e24fc6b981f2cfa503442b/users/13c2b2528e8e47dda63960ec1d302b60/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:02.306303 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072d31e-133d-4335-90b6-fa0e025e16aa admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:02.316694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072d31e-133d-4335-90b6-fa0e025e16aa admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:02.372266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf0a45-8fd0-4754-82d7-468e3d470179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:02.372951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0a45-8fd0-4754-82d7-468e3d470179 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:02.373229 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0a45-8fd0-4754-82d7-468e3d470179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:02.373500 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf0a45-8fd0-4754-82d7-468e3d470179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:02.374248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf0a45-8fd0-4754-82d7-468e3d470179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:02.375843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf0a45-8fd0-4754-82d7-468e3d470179 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:02.385278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1328/2666] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:02.389533 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35c68-9735-4e1b-9dfe-c3740a1b134a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:02.399776 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b35c68-9735-4e1b-9dfe-c3740a1b134a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:02.404442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:02.405349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:02.405626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:02.405896 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] PATH_INFO: `/v3/projects/24c65b7a75e24fc6b981f2cfa503442b/users/13c2b2528e8e47dda63960ec1d302b60/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:02.407916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c65b7a75e24fc6b981f2cfa503442b, user_id=13c2b2528e8e47dda63960ec1d302b60, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:02.410642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:02.421649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1339/2667] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:02 2022] PUT /identity/v3/projects/24c65b7a75e24fc6b981f2cfa503442b/users/13c2b2528e8e47dda63960ec1d302b60/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:02.439062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4aef9-f027-4228-9465-462bb28aa49d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:02.439346 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4aef9-f027-4228-9465-462bb28aa49d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:02.439621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4aef9-f027-4228-9465-462bb28aa49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:02.465156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-20d4aef9-f027-4228-9465-462bb28aa49d None None] MFA Rules not processed for user `13c2b2528e8e47dda63960ec1d302b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:02.466385 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-20d4aef9-f027-4228-9465-462bb28aa49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:02.532573 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1329/2668] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:54:02.544478 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:02.546212 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:02.567470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:02.605967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8aca1d-b49c-4054-8e91-21c753553faa admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:02.609602 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ded7d-aff9-4670-aa20-f40c7c42eaac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:02.610304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ded7d-aff9-4670-aa20-f40c7c42eaac service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:02.610630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ded7d-aff9-4670-aa20-f40c7c42eaac service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:02.610899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ded7d-aff9-4670-aa20-f40c7c42eaac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:02.619640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ded7d-aff9-4670-aa20-f40c7c42eaac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:02.621057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ded7d-aff9-4670-aa20-f40c7c42eaac service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:02.630870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1340/2669] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:02 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:03.483628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4aef9-f027-4228-9465-462bb28aa49d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:03.533216 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:03.565757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4aef9-f027-4228-9465-462bb28aa49d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:03.571657 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:03.574912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:03.574912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:03.574912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] PATH_INFO: `/v3/users/1e50bd9538ef4756b6340108ed01cce8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:03.575945 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e50bd9538ef4756b6340108ed01cce8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:03.579415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:03.804156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e50bd9538ef4756b6340108ed01cce8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:03.875107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e50bd9538ef4756b6340108ed01cce8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:03.882780 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e50bd9538ef4756b6340108ed01cce8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:03.883414 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e50bd9538ef4756b6340108ed01cce8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:03.896209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e50bd9538ef4756b6340108ed01cce8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:03.903138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1330/2670] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:03 2022] DELETE /identity/v3/users/1e50bd9538ef4756b6340108ed01cce8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:03.907588 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38dedf-b8ba-4047-ad47-ed104ca788ef None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:03.908066 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38dedf-b8ba-4047-ad47-ed104ca788ef None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:03.908167 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38dedf-b8ba-4047-ad47-ed104ca788ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:03.924998 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-cd38dedf-b8ba-4047-ad47-ed104ca788ef None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:03.926346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cd38dedf-b8ba-4047-ad47-ed104ca788ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:03.986414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1341/2671] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:54:03.996335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:03.997802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:04.054918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a313589-7c0b-4ed3-b55f-36cedcdf2fa2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:04.059245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d8ee-46e2-4917-b149-a04894cca8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:04.059897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d8ee-46e2-4917-b149-a04894cca8de service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:04.060181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d8ee-46e2-4917-b149-a04894cca8de service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:04.060458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d8ee-46e2-4917-b149-a04894cca8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:04.069563 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d8ee-46e2-4917-b149-a04894cca8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:04.071015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d8ee-46e2-4917-b149-a04894cca8de service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:04.081209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1331/2672] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:04.487941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38dedf-b8ba-4047-ad47-ed104ca788ef None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:04.489639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-cd38dedf-b8ba-4047-ad47-ed104ca788ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:04.503945 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38dedf-b8ba-4047-ad47-ed104ca788ef None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:04.509182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:04.510271 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:04.510545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:04.510817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] PATH_INFO: `/v3/projects/a9878e2b8d81462dba36f1426a6955da` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:04.512053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9878e2b8d81462dba36f1426a6955da)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:04.514026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:04.624145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9878e2b8d81462dba36f1426a6955da', 'request_id': 'req-1edf5d5d-f198-4767-8d37-89a69ae0e798'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:04.697821 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9878e2b8d81462dba36f1426a6955da', 'request_id': 'req-1edf5d5d-f198-4767-8d37-89a69ae0e798'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:04.703880 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9878e2b8d81462dba36f1426a6955da', 'request_id': 'req-1edf5d5d-f198-4767-8d37-89a69ae0e798'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:04.714698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] The token cache is being invalidate because project a9878e2b8d81462dba36f1426a6955da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:04.714976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:04.715589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:04.717108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1342/2673] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:04 2022] DELETE /identity/v3/projects/a9878e2b8d81462dba36f1426a6955da => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:04.721320 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d8ee-46e2-4917-b149-a04894cca8de service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:04.732040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d8ee-46e2-4917-b149-a04894cca8de service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:04.787271 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:04.789576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:04.789576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:04.789576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] PATH_INFO: `/v3/users/13c2b2528e8e47dda63960ec1d302b60` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:04.790070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c2b2528e8e47dda63960ec1d302b60)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:04.792654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:04.794478 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:04.986103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c2b2528e8e47dda63960ec1d302b60'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.063839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c2b2528e8e47dda63960ec1d302b60'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.071251 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c2b2528e8e47dda63960ec1d302b60'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.071914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c2b2528e8e47dda63960ec1d302b60'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.083746 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e51f8a21-5352-4482-8920-b0a81fbecf5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c2b2528e8e47dda63960ec1d302b60'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.090427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1332/2674] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:04 2022] DELETE /identity/v3/users/13c2b2528e8e47dda63960ec1d302b60 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:05.442149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:05.443704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:05.461529 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5d5d-f198-4767-8d37-89a69ae0e798 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:05.505493 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:05.520089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:05.521611 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:05.521913 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:05.522216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] PATH_INFO: `/v3/projects/24c65b7a75e24fc6b981f2cfa503442b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:05.523404 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c65b7a75e24fc6b981f2cfa503442b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:05.525345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:05.628925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c65b7a75e24fc6b981f2cfa503442b', 'request_id': 'req-456bdfe6-94e2-4113-9565-44fe1656667d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.697633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c65b7a75e24fc6b981f2cfa503442b', 'request_id': 'req-456bdfe6-94e2-4113-9565-44fe1656667d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.703326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c65b7a75e24fc6b981f2cfa503442b', 'request_id': 'req-456bdfe6-94e2-4113-9565-44fe1656667d'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.714778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] The token cache is being invalidate because project 24c65b7a75e24fc6b981f2cfa503442b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:05.715085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.715688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-456bdfe6-94e2-4113-9565-44fe1656667d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:05.717205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1343/2675] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:05 2022] DELETE /identity/v3/projects/24c65b7a75e24fc6b981f2cfa503442b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:05.722089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6601e8-b804-4d3c-ad43-147234668a75 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:05.722574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6601e8-b804-4d3c-ad43-147234668a75 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:05.722695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6601e8-b804-4d3c-ad43-147234668a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:05.741106 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1f6601e8-b804-4d3c-ad43-147234668a75 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:05.742312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1f6601e8-b804-4d3c-ad43-147234668a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:05.800085 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1333/2676] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:05.807775 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000ea30-e883-4fe4-8c99-a36aaed04634 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:05.808649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000ea30-e883-4fe4-8c99-a36aaed04634 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:05.808937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000ea30-e883-4fe4-8c99-a36aaed04634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:05.827359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-8000ea30-e883-4fe4-8c99-a36aaed04634 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:05.828544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8000ea30-e883-4fe4-8c99-a36aaed04634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:05.836277 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1344/2677] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:05.841278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6601e8-b804-4d3c-ad43-147234668a75 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:05.850745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6601e8-b804-4d3c-ad43-147234668a75 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:05.856244 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:05.856889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:05.857170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:05.857442 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:05.858196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:54:05.858502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:05.860101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:05.871969 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1334/2678] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:54:05.876170 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000ea30-e883-4fe4-8c99-a36aaed04634 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:05.885366 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000ea30-e883-4fe4-8c99-a36aaed04634 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:05.890556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463f447-2aa5-44a4-925a-af83529be6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:05.891276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f447-2aa5-44a4-925a-af83529be6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:05.891550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f447-2aa5-44a4-925a-af83529be6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:05.891817 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f447-2aa5-44a4-925a-af83529be6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:05.892506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463f447-2aa5-44a4-925a-af83529be6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:05.894408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463f447-2aa5-44a4-925a-af83529be6dd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:05.983794 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1345/2679] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:54:05 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:05.988061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:05.998133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea96200-d337-40b3-978e-bd2b2f635402 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:06.057579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68c23-8708-4e13-9735-e4bc943d4017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:06.058400 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68c23-8708-4e13-9735-e4bc943d4017 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:06.058684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68c23-8708-4e13-9735-e4bc943d4017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:06.058958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e68c23-8708-4e13-9735-e4bc943d4017 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:06.059644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e68c23-8708-4e13-9735-e4bc943d4017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:06.061980 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e68c23-8708-4e13-9735-e4bc943d4017 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:06.072422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:06.149170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1335/2680] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:54:05 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:54:06.153847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463f447-2aa5-44a4-925a-af83529be6dd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:06.164306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463f447-2aa5-44a4-925a-af83529be6dd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:06.169624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7b6d-afae-4681-8941-9878e8cf122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:06.170308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7b6d-afae-4681-8941-9878e8cf122a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:06.170587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7b6d-afae-4681-8941-9878e8cf122a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:06.170858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7b6d-afae-4681-8941-9878e8cf122a admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:06.171580 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7b6d-afae-4681-8941-9878e8cf122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:06.173273 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7b6d-afae-4681-8941-9878e8cf122a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:06.183763 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1346/2681] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:06.187714 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68c23-8708-4e13-9735-e4bc943d4017 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:06.197422 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e68c23-8708-4e13-9735-e4bc943d4017 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:06.202830 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51177b-35bf-4553-8f93-3e1bd2327c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:06.203464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51177b-35bf-4553-8f93-3e1bd2327c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:06.203740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51177b-35bf-4553-8f93-3e1bd2327c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:06.204010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51177b-35bf-4553-8f93-3e1bd2327c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:06.204771 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51177b-35bf-4553-8f93-3e1bd2327c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:06.206367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51177b-35bf-4553-8f93-3e1bd2327c05 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:06.216504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1336/2682] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:54:06.220593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7b6d-afae-4681-8941-9878e8cf122a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:06.230767 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7b6d-afae-4681-8941-9878e8cf122a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:06.235444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:06.236312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:06.236587 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:06.236855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] PATH_INFO: `/v3/projects/0add8011ab9145b5b30cee4a00d74194/users/5324e60bccd343658bc8f93267772689/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:06.251732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0add8011ab9145b5b30cee4a00d74194, user_id=5324e60bccd343658bc8f93267772689, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:06.254413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:06.356536 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1347/2683] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:06 2022] PUT /identity/v3/projects/0add8011ab9145b5b30cee4a00d74194/users/5324e60bccd343658bc8f93267772689/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:06.368057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8ee4-8ac3-4829-9577-58bc58f00a58 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:06.368342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8ee4-8ac3-4829-9577-58bc58f00a58 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:06.368614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c8ee4-8ac3-4829-9577-58bc58f00a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:06.396904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7e4c8ee4-8ac3-4829-9577-58bc58f00a58 None None] MFA Rules not processed for user `5324e60bccd343658bc8f93267772689`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:06.398204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7e4c8ee4-8ac3-4829-9577-58bc58f00a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:06.463630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1337/2684] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:06.475639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:06.477370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:06.536501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce3507-1009-4e2d-8044-2335f4fb9548 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:06.540244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effb45b-44f5-430f-9beb-5974efb0418c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:06.540892 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effb45b-44f5-430f-9beb-5974efb0418c service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:06.541175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effb45b-44f5-430f-9beb-5974efb0418c service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:06.541452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effb45b-44f5-430f-9beb-5974efb0418c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:06.550798 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effb45b-44f5-430f-9beb-5974efb0418c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:06.552230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effb45b-44f5-430f-9beb-5974efb0418c service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:06.561363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1348/2685] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:06.580473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8ee4-8ac3-4829-9577-58bc58f00a58 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:06.649907 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c8ee4-8ac3-4829-9577-58bc58f00a58 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:06.655839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:06.656745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:06.657020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:06.657297 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] PATH_INFO: `/v3/users/5324e60bccd343658bc8f93267772689` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:06.658517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5324e60bccd343658bc8f93267772689)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:06.660443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:06.877850 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5324e60bccd343658bc8f93267772689'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:06.937653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5324e60bccd343658bc8f93267772689'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:06.945205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5324e60bccd343658bc8f93267772689'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:06.945868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5324e60bccd343658bc8f93267772689'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:06.956854 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:06.958902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5324e60bccd343658bc8f93267772689'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:06.965740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1338/2686] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:06 2022] DELETE /identity/v3/users/5324e60bccd343658bc8f93267772689 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:54:06.970718 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1ed1c-95d3-43a7-9e88-aadc4f9d6e68 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:06.971069 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1ed1c-95d3-43a7-9e88-aadc4f9d6e68 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:06.971407 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1ed1c-95d3-43a7-9e88-aadc4f9d6e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:06.989047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-78f1ed1c-95d3-43a7-9e88-aadc4f9d6e68 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:06.990346 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-78f1ed1c-95d3-43a7-9e88-aadc4f9d6e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:06.998989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:07.050511 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1349/2687] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:07.063844 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:07.065315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:07.126226 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300d91-5061-4ac7-9034-b42be53fceb4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:07.129921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:07.130603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:07.130917 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:07.131221 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:07.142304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:07.143787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:07.154973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1339/2688] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:07.207964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1ed1c-95d3-43a7-9e88-aadc4f9d6e68 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:07.209376 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-78f1ed1c-95d3-43a7-9e88-aadc4f9d6e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:07.336127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1ed1c-95d3-43a7-9e88-aadc4f9d6e68 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:07.346203 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526649c3-55e3-4000-bd79-f785b564dbcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:07.346501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526649c3-55e3-4000-bd79-f785b564dbcb service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:07.346812 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526649c3-55e3-4000-bd79-f785b564dbcb service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:07.347086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526649c3-55e3-4000-bd79-f785b564dbcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:07.349099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-526649c3-55e3-4000-bd79-f785b564dbcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:07.365703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526649c3-55e3-4000-bd79-f785b564dbcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:07.367440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526649c3-55e3-4000-bd79-f785b564dbcb service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:07.391647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1350/2689] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:07.602161 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:07.605094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:07.636749 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd887d-1094-49fb-bacf-7a01a24cf681 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:07.642627 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:07.645408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:07.645408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:07.645408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] PATH_INFO: `/v3/projects/0add8011ab9145b5b30cee4a00d74194` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:07.646142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0add8011ab9145b5b30cee4a00d74194)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:07.648055 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:07.767721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0add8011ab9145b5b30cee4a00d74194', 'request_id': 'req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:07.833736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0add8011ab9145b5b30cee4a00d74194', 'request_id': 'req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:07.841112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0add8011ab9145b5b30cee4a00d74194', 'request_id': 'req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:07.853294 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] The token cache is being invalidate because project 0add8011ab9145b5b30cee4a00d74194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:07.853584 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:07.854369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fddf0bd-9dca-43e6-95d9-8573a3b88eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:07.857197 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1340/2690] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:07 2022] DELETE /identity/v3/projects/0add8011ab9145b5b30cee4a00d74194 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:07.862371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310753-abbf-488b-83e4-96b042654750 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:07.862864 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310753-abbf-488b-83e4-96b042654750 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:07.862970 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63310753-abbf-488b-83e4-96b042654750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:07.882213 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-63310753-abbf-488b-83e4-96b042654750 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:07.883442 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-63310753-abbf-488b-83e4-96b042654750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:07.946145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1351/2691] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:54:07.954277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1ff4-4cfe-464a-8e51-e1d9ea55684f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:07.954801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1ff4-4cfe-464a-8e51-e1d9ea55684f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:07.954908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1ff4-4cfe-464a-8e51-e1d9ea55684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:07.974874 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8a9f1ff4-4cfe-464a-8e51-e1d9ea55684f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:07.976030 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8a9f1ff4-4cfe-464a-8e51-e1d9ea55684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:07.986047 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1341/2692] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:54:07.990472 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63310753-abbf-488b-83e4-96b042654750 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.000589 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63310753-abbf-488b-83e4-96b042654750 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.005681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.006433 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.006719 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.007058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] PATH_INFO: `/v3/domains` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.007785 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80364) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:54:08.008159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.009836 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.019473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:08.023266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1352/2693] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:54:08.028010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f1ff4-4cfe-464a-8e51-e1d9ea55684f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.038931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f1ff4-4cfe-464a-8e51-e1d9ea55684f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.045130 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf03b1-5c6b-44fa-8a99-012c5e7b1e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.045905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf03b1-5c6b-44fa-8a99-012c5e7b1e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.046342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf03b1-5c6b-44fa-8a99-012c5e7b1e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.046692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf03b1-5c6b-44fa-8a99-012c5e7b1e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.047411 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf03b1-5c6b-44fa-8a99-012c5e7b1e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.049310 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf03b1-5c6b-44fa-8a99-012c5e7b1e7c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.150816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1342/2694] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:54:08 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:08.163073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.174351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e7b87-955b-4e1c-9a4a-9c046cce4083 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.235418 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4efd3-a800-4cc8-b9b2-08793e21ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.241955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4efd3-a800-4cc8-b9b2-08793e21ecbd admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.241955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4efd3-a800-4cc8-b9b2-08793e21ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.241955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4efd3-a800-4cc8-b9b2-08793e21ecbd admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.241955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4efd3-a800-4cc8-b9b2-08793e21ecbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.241955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4efd3-a800-4cc8-b9b2-08793e21ecbd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.302140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1353/2695] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:54:08 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:08.303323 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf03b1-5c6b-44fa-8a99-012c5e7b1e7c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.314594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf03b1-5c6b-44fa-8a99-012c5e7b1e7c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.320768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ace6c-d1cf-4ca1-a10f-208f6ef3ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.320768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ace6c-d1cf-4ca1-a10f-208f6ef3ad97 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.320768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ace6c-d1cf-4ca1-a10f-208f6ef3ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.320768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ace6c-d1cf-4ca1-a10f-208f6ef3ad97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.321189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ace6c-d1cf-4ca1-a10f-208f6ef3ad97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.322715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ace6c-d1cf-4ca1-a10f-208f6ef3ad97 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.334726 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1343/2696] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:08.338520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4efd3-a800-4cc8-b9b2-08793e21ecbd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.349944 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4efd3-a800-4cc8-b9b2-08793e21ecbd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.355818 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb5148-475c-4bdf-b3bd-e09d04f46c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.356495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb5148-475c-4bdf-b3bd-e09d04f46c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.356777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb5148-475c-4bdf-b3bd-e09d04f46c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.357053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb5148-475c-4bdf-b3bd-e09d04f46c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.357793 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb5148-475c-4bdf-b3bd-e09d04f46c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.359523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb5148-475c-4bdf-b3bd-e09d04f46c79 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.371128 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1354/2697] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:08.374704 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ace6c-d1cf-4ca1-a10f-208f6ef3ad97 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.385169 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ace6c-d1cf-4ca1-a10f-208f6ef3ad97 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.391348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbac9c-9433-45c4-937f-6908c5a1234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.392237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbac9c-9433-45c4-937f-6908c5a1234a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.392517 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbac9c-9433-45c4-937f-6908c5a1234a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.392789 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbac9c-9433-45c4-937f-6908c5a1234a admin admin] PATH_INFO: `/v3/projects/eb224d6ba42940b799e64628676b4745/users/584ad4813140417a913034f11dde511d/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.409037 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbac9c-9433-45c4-937f-6908c5a1234a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb224d6ba42940b799e64628676b4745, user_id=584ad4813140417a913034f11dde511d, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.411799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbac9c-9433-45c4-937f-6908c5a1234a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.470355 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1344/2698] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:08 2022] PUT /identity/v3/projects/eb224d6ba42940b799e64628676b4745/users/584ad4813140417a913034f11dde511d/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:08.480541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676a48e-de97-43ef-8386-c3b7798288d8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.480759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676a48e-de97-43ef-8386-c3b7798288d8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.481059 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676a48e-de97-43ef-8386-c3b7798288d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.506741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5676a48e-de97-43ef-8386-c3b7798288d8 None None] MFA Rules not processed for user `584ad4813140417a913034f11dde511d`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:08.507932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5676a48e-de97-43ef-8386-c3b7798288d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:08.572186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1355/2699] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:54:08.577502 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbac9c-9433-45c4-937f-6908c5a1234a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.594889 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:08.638995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbac9c-9433-45c4-937f-6908c5a1234a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.643636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e29a7-7bff-43fb-a70a-915ec1a44e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.644330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e29a7-7bff-43fb-a70a-915ec1a44e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.644604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e29a7-7bff-43fb-a70a-915ec1a44e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.644873 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e29a7-7bff-43fb-a70a-915ec1a44e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.645548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e29a7-7bff-43fb-a70a-915ec1a44e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.647740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e29a7-7bff-43fb-a70a-915ec1a44e04 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.730947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1345/2700] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:54:08 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:08.732022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676a48e-de97-43ef-8386-c3b7798288d8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.743290 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676a48e-de97-43ef-8386-c3b7798288d8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.804270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698501db-9ccf-45ef-bd01-4563daf09a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.804973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698501db-9ccf-45ef-bd01-4563daf09a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.805253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698501db-9ccf-45ef-bd01-4563daf09a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.805526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698501db-9ccf-45ef-bd01-4563daf09a56 admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.806259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698501db-9ccf-45ef-bd01-4563daf09a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.808764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698501db-9ccf-45ef-bd01-4563daf09a56 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.876173 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:08.882742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1356/2701] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:54:08 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:08.886526 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e29a7-7bff-43fb-a70a-915ec1a44e04 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.896971 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e29a7-7bff-43fb-a70a-915ec1a44e04 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.901735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85e83e-18a7-4e9c-a234-cda1051d538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.902340 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85e83e-18a7-4e9c-a234-cda1051d538c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.902781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85e83e-18a7-4e9c-a234-cda1051d538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.903064 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85e83e-18a7-4e9c-a234-cda1051d538c admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.903799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85e83e-18a7-4e9c-a234-cda1051d538c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.905402 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85e83e-18a7-4e9c-a234-cda1051d538c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.921163 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1346/2702] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:08.923200 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698501db-9ccf-45ef-bd01-4563daf09a56 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.934736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698501db-9ccf-45ef-bd01-4563daf09a56 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.939567 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fce68-520f-4f33-b232-1e68a824c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.940241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fce68-520f-4f33-b232-1e68a824c862 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.940528 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fce68-520f-4f33-b232-1e68a824c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.940807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fce68-520f-4f33-b232-1e68a824c862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.941541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fce68-520f-4f33-b232-1e68a824c862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:08.943246 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fce68-520f-4f33-b232-1e68a824c862 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:08.958467 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1357/2703] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:08.960010 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85e83e-18a7-4e9c-a234-cda1051d538c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:08.973403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85e83e-18a7-4e9c-a234-cda1051d538c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:08.979632 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03300a29-b984-485e-b4c4-3065a99442e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:08.981255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03300a29-b984-485e-b4c4-3065a99442e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:08.981549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03300a29-b984-485e-b4c4-3065a99442e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:08.981899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03300a29-b984-485e-b4c4-3065a99442e1 admin admin] PATH_INFO: `/v3/projects/5f5c67dcd4834ee883b7b9bad09beac7/users/ee644564e6fe4e92be0c3c2db2438a3b/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:08.999732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03300a29-b984-485e-b4c4-3065a99442e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f5c67dcd4834ee883b7b9bad09beac7, user_id=ee644564e6fe4e92be0c3c2db2438a3b, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:09.002458 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03300a29-b984-485e-b4c4-3065a99442e1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:09.103718 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1347/2704] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:08 2022] PUT /identity/v3/projects/5f5c67dcd4834ee883b7b9bad09beac7/users/ee644564e6fe4e92be0c3c2db2438a3b/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:09.114890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65369-1b41-443c-8442-1b90ee8146e8 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:09.115169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65369-1b41-443c-8442-1b90ee8146e8 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:09.115441 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb65369-1b41-443c-8442-1b90ee8146e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:09.142207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ccb65369-1b41-443c-8442-1b90ee8146e8 None None] MFA Rules not processed for user `ee644564e6fe4e92be0c3c2db2438a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:09.143390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ccb65369-1b41-443c-8442-1b90ee8146e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:09.207990 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1358/2705] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:09.212568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03300a29-b984-485e-b4c4-3065a99442e1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:09.273539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03300a29-b984-485e-b4c4-3065a99442e1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:09.279044 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301005e9-f24a-4165-82d4-2b53be7b8893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:09.279694 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301005e9-f24a-4165-82d4-2b53be7b8893 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:09.279973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301005e9-f24a-4165-82d4-2b53be7b8893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:09.280248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301005e9-f24a-4165-82d4-2b53be7b8893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:09.280941 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301005e9-f24a-4165-82d4-2b53be7b8893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:09.282849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301005e9-f24a-4165-82d4-2b53be7b8893 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:09.362152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1348/2706] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:54:09 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:09.366390 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65369-1b41-443c-8442-1b90ee8146e8 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:09.378622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb65369-1b41-443c-8442-1b90ee8146e8 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:09.436723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca393e0-55ee-412b-9dec-4185fac9eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:09.437384 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca393e0-55ee-412b-9dec-4185fac9eafd admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:09.437667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca393e0-55ee-412b-9dec-4185fac9eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:09.437941 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca393e0-55ee-412b-9dec-4185fac9eafd admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:09.438665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca393e0-55ee-412b-9dec-4185fac9eafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:09.440576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca393e0-55ee-412b-9dec-4185fac9eafd admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:09.600977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1359/2707] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:54:09 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:54:09.605102 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301005e9-f24a-4165-82d4-2b53be7b8893 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:09.615330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301005e9-f24a-4165-82d4-2b53be7b8893 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:09.620734 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0294e-9abd-4c70-b538-5ef954d838a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:09.621645 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0294e-9abd-4c70-b538-5ef954d838a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:09.621952 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0294e-9abd-4c70-b538-5ef954d838a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:09.622291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0294e-9abd-4c70-b538-5ef954d838a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:09.623045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0294e-9abd-4c70-b538-5ef954d838a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:09.624709 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0294e-9abd-4c70-b538-5ef954d838a7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:09.635434 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1349/2708] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:09.640080 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca393e0-55ee-412b-9dec-4185fac9eafd admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:09.650095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca393e0-55ee-412b-9dec-4185fac9eafd admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:09.654835 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f5f37-1d79-4822-88b7-5435a0dc9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:09.655710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f5f37-1d79-4822-88b7-5435a0dc9d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:09.655992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f5f37-1d79-4822-88b7-5435a0dc9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:09.656344 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f5f37-1d79-4822-88b7-5435a0dc9d8f admin admin] PATH_INFO: `/v3/projects/45f7acbac43d4f6d9662814b94504db3/users/6962ce4653e541208955371ee73585a8/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:09.672021 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f5f37-1d79-4822-88b7-5435a0dc9d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f7acbac43d4f6d9662814b94504db3, user_id=6962ce4653e541208955371ee73585a8, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:09.674710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f5f37-1d79-4822-88b7-5435a0dc9d8f admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:09.720639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1360/2709] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:09 2022] PUT /identity/v3/projects/45f7acbac43d4f6d9662814b94504db3/users/6962ce4653e541208955371ee73585a8/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:09.724548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0294e-9abd-4c70-b538-5ef954d838a7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:09.735374 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0294e-9abd-4c70-b538-5ef954d838a7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:09.774253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:09.793736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873d332-4d2c-49bf-8d97-b3fbe0db51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:09.794464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d332-4d2c-49bf-8d97-b3fbe0db51da admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:09.795242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d332-4d2c-49bf-8d97-b3fbe0db51da admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:09.795751 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d332-4d2c-49bf-8d97-b3fbe0db51da admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:09.796618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873d332-4d2c-49bf-8d97-b3fbe0db51da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:09.798790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873d332-4d2c-49bf-8d97-b3fbe0db51da admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:09.810317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1350/2710] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:09.814515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f5f37-1d79-4822-88b7-5435a0dc9d8f admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:09.826337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f5f37-1d79-4822-88b7-5435a0dc9d8f admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:09.831168 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:09.832058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:09.832334 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:09.832604 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] PATH_INFO: `/v3/projects/45f7acbac43d4f6d9662814b94504db3/users/6962ce4653e541208955371ee73585a8/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:09.834752 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f7acbac43d4f6d9662814b94504db3, user_id=6962ce4653e541208955371ee73585a8, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:09.837369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:09.849412 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1361/2711] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:09 2022] PUT /identity/v3/projects/45f7acbac43d4f6d9662814b94504db3/users/6962ce4653e541208955371ee73585a8/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:09.860257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3116ba-0a73-43e4-b987-617ee23faf25 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:09.860581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3116ba-0a73-43e4-b987-617ee23faf25 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:09.860929 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3116ba-0a73-43e4-b987-617ee23faf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:09.891531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ef3116ba-0a73-43e4-b987-617ee23faf25 None None] MFA Rules not processed for user `6962ce4653e541208955371ee73585a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:09.892773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ef3116ba-0a73-43e4-b987-617ee23faf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:09.968228 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1351/2712] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:54:09.978248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:09.978248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:10.008931 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:10.037020 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7da427-29e5-4800-a02b-d11b7db421ea admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:10.047986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b684a-0489-4124-9662-dcbd2198ee22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:10.048654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b684a-0489-4124-9662-dcbd2198ee22 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:10.048958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b684a-0489-4124-9662-dcbd2198ee22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:10.049211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b684a-0489-4124-9662-dcbd2198ee22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:10.115711 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b684a-0489-4124-9662-dcbd2198ee22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:10.117100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b684a-0489-4124-9662-dcbd2198ee22 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:10.129121 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1362/2713] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:12.073190 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3116ba-0a73-43e4-b987-617ee23faf25 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:12.074622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ef3116ba-0a73-43e4-b987-617ee23faf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:12.087057 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3116ba-0a73-43e4-b987-617ee23faf25 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:12.090530 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535f14-7775-483e-a1b4-b3e86c53a452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:12.091153 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535f14-7775-483e-a1b4-b3e86c53a452 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:12.092154 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535f14-7775-483e-a1b4-b3e86c53a452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:12.092436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535f14-7775-483e-a1b4-b3e86c53a452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:12.146606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535f14-7775-483e-a1b4-b3e86c53a452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:12.148020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535f14-7775-483e-a1b4-b3e86c53a452 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:12.157117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1352/2714] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:13.583323 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b684a-0489-4124-9662-dcbd2198ee22 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:13.591688 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b684a-0489-4124-9662-dcbd2198ee22 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:13.595401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a27be9-f2aa-44c7-ba0f-cea1469eeef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:13.596022 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a27be9-f2aa-44c7-ba0f-cea1469eeef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:13.596326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a27be9-f2aa-44c7-ba0f-cea1469eeef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:13.596597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a27be9-f2aa-44c7-ba0f-cea1469eeef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:13.605671 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a27be9-f2aa-44c7-ba0f-cea1469eeef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:13.607127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a27be9-f2aa-44c7-ba0f-cea1469eeef0 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:13.617692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1363/2715] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:18.372560 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535f14-7775-483e-a1b4-b3e86c53a452 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:18.438647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535f14-7775-483e-a1b4-b3e86c53a452 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:18.443412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:18.444403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:18.444864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:18.444995 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] PATH_INFO: `/v3/users/584ad4813140417a913034f11dde511d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:18.446219 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=584ad4813140417a913034f11dde511d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:18.448278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:18.460909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:18.626961 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584ad4813140417a913034f11dde511d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:18.669430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584ad4813140417a913034f11dde511d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:18.678464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584ad4813140417a913034f11dde511d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:18.679200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584ad4813140417a913034f11dde511d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:18.691663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584ad4813140417a913034f11dde511d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:18.697953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1353/2716] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:18 2022] DELETE /identity/v3/users/584ad4813140417a913034f11dde511d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:18.702642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c686-ee37-479b-b329-ac2c45efe773 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:18.703111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c686-ee37-479b-b329-ac2c45efe773 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:18.704316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c686-ee37-479b-b329-ac2c45efe773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:18.720008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-add8c686-ee37-479b-b329-ac2c45efe773 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:18.721574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-add8c686-ee37-479b-b329-ac2c45efe773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:18.787652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1364/2717] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:18.798391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:18.799879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:18.861119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841381c6-d757-4737-8de6-6e712ca3f1fa admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:18.864786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8cdec-2efd-4fb4-ae94-7f4b955205ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:18.865472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8cdec-2efd-4fb4-ae94-7f4b955205ed service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:18.865696 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8cdec-2efd-4fb4-ae94-7f4b955205ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:18.865971 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8cdec-2efd-4fb4-ae94-7f4b955205ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:18.877307 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8cdec-2efd-4fb4-ae94-7f4b955205ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:18.878868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8cdec-2efd-4fb4-ae94-7f4b955205ed service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:18.889523 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1354/2718] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:19.314932 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c686-ee37-479b-b329-ac2c45efe773 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:19.316408 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-add8c686-ee37-479b-b329-ac2c45efe773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:19.329047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c686-ee37-479b-b329-ac2c45efe773 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:19.333832 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:19.334764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:19.335037 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:19.335304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] PATH_INFO: `/v3/projects/eb224d6ba42940b799e64628676b4745` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:19.336470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb224d6ba42940b799e64628676b4745)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:19.338544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:19.471350 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb224d6ba42940b799e64628676b4745', 'request_id': 'req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.532285 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb224d6ba42940b799e64628676b4745', 'request_id': 'req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.538423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb224d6ba42940b799e64628676b4745', 'request_id': 'req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.539487 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:19.550806 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] The token cache is being invalidate because project eb224d6ba42940b799e64628676b4745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:19.551092 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.551723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.553240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1365/2719] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:19 2022] DELETE /identity/v3/projects/eb224d6ba42940b799e64628676b4745 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:19.557256 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8cdec-2efd-4fb4-ae94-7f4b955205ed service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:19.567196 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8cdec-2efd-4fb4-ae94-7f4b955205ed service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:19.625141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:19.626014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:19.626309 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:19.626583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] PATH_INFO: `/v3/users/ee644564e6fe4e92be0c3c2db2438a3b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:19.627816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee644564e6fe4e92be0c3c2db2438a3b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:19.629722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:19.652287 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:19.861647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee644564e6fe4e92be0c3c2db2438a3b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.944481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee644564e6fe4e92be0c3c2db2438a3b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.953006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee644564e6fe4e92be0c3c2db2438a3b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.953737 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee644564e6fe4e92be0c3c2db2438a3b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.966570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee644564e6fe4e92be0c3c2db2438a3b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:19.973472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1355/2720] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:19 2022] DELETE /identity/v3/users/ee644564e6fe4e92be0c3c2db2438a3b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:20.366622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:20.370265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:20.386882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1014576-7f0a-4d10-98ba-bb1f60d46c4e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:20.461345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:20.462369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:20.462656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:20.462931 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] PATH_INFO: `/v3/projects/5f5c67dcd4834ee883b7b9bad09beac7` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:20.464122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f5c67dcd4834ee883b7b9bad09beac7)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:20.466099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:20.611952 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f5c67dcd4834ee883b7b9bad09beac7', 'request_id': 'req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:20.684885 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f5c67dcd4834ee883b7b9bad09beac7', 'request_id': 'req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:20.692216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f5c67dcd4834ee883b7b9bad09beac7', 'request_id': 'req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:20.705603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] The token cache is being invalidate because project 5f5c67dcd4834ee883b7b9bad09beac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:20.705889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:20.706625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:20.708228 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1366/2721] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:20 2022] DELETE /identity/v3/projects/5f5c67dcd4834ee883b7b9bad09beac7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:20.712125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:20.716768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:20.726488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e9c65-9c0e-4c63-b145-7ac5a6235a82 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:20.784337 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:20.785209 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:20.785488 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:20.785764 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] PATH_INFO: `/v3/users/6962ce4653e541208955371ee73585a8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:20.786975 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6962ce4653e541208955371ee73585a8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:20.788888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:20.990304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6962ce4653e541208955371ee73585a8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.046427 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6962ce4653e541208955371ee73585a8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.054354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6962ce4653e541208955371ee73585a8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.055046 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6962ce4653e541208955371ee73585a8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.068471 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-88aebb01-6f47-4e14-9c16-f26245ab6983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6962ce4653e541208955371ee73585a8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.075091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1356/2722] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:20 2022] DELETE /identity/v3/users/6962ce4653e541208955371ee73585a8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:21.618968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:21.623973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:21.633225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd70a1-8bd2-4c3b-b6aa-c2291f96bc44 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:21.690132 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:21.691026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:21.691301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:21.691571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] PATH_INFO: `/v3/projects/45f7acbac43d4f6d9662814b94504db3` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:21.692958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f7acbac43d4f6d9662814b94504db3)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:21.694958 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:21.779240 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:21.797077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f7acbac43d4f6d9662814b94504db3', 'request_id': 'req-e7f357b5-6806-47fd-98a8-2d55cc8e555b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.851550 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f7acbac43d4f6d9662814b94504db3', 'request_id': 'req-e7f357b5-6806-47fd-98a8-2d55cc8e555b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.858592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f7acbac43d4f6d9662814b94504db3', 'request_id': 'req-e7f357b5-6806-47fd-98a8-2d55cc8e555b'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.870414 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] The token cache is being invalidate because project 45f7acbac43d4f6d9662814b94504db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:21.870640 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.871297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-e7f357b5-6806-47fd-98a8-2d55cc8e555b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:21.877569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1367/2723] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:21 2022] DELETE /identity/v3/projects/45f7acbac43d4f6d9662814b94504db3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:21.880604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe298ce-2d1e-455f-84a8-785131c073df None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:21.880604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe298ce-2d1e-455f-84a8-785131c073df None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:21.880604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe298ce-2d1e-455f-84a8-785131c073df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:21.898148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cbe298ce-2d1e-455f-84a8-785131c073df None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:21.899376 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cbe298ce-2d1e-455f-84a8-785131c073df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:21.913450 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:21.963559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1357/2724] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:21.974803 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5e676-35f0-4245-9f57-276d44603d94 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:21.975086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5e676-35f0-4245-9f57-276d44603d94 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:21.975359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5e676-35f0-4245-9f57-276d44603d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:21.994713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-82b5e676-35f0-4245-9f57-276d44603d94 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:21.996964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-82b5e676-35f0-4245-9f57-276d44603d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:22.004753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1368/2725] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:22.008968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe298ce-2d1e-455f-84a8-785131c073df None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:22.019882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe298ce-2d1e-455f-84a8-785131c073df None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:22.024424 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:22.025072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.025350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.025622 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.026387 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:54:22.026686 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:22.028266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:22.040056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1358/2726] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:54:22.046099 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5e676-35f0-4245-9f57-276d44603d94 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:22.054145 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5e676-35f0-4245-9f57-276d44603d94 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:22.059153 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69103c61-b601-44d5-a3eb-8888120a66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:22.059827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69103c61-b601-44d5-a3eb-8888120a66ce admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.060209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69103c61-b601-44d5-a3eb-8888120a66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.060428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69103c61-b601-44d5-a3eb-8888120a66ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.061631 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69103c61-b601-44d5-a3eb-8888120a66ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:22.066191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69103c61-b601-44d5-a3eb-8888120a66ce admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:22.082913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:22.084659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:22.130893 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1369/2727] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:54:22 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:54:22.131925 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69103c61-b601-44d5-a3eb-8888120a66ce admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:22.142862 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd37d1b-cabe-4b36-a199-1e4e8f210571 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:22.193185 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:22.193833 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.194155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.194435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.195042 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69103c61-b601-44d5-a3eb-8888120a66ce admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:22.196263 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:22.199723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e13a-2be0-4953-9ef1-346c536d9b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:22.200370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e13a-2be0-4953-9ef1-346c536d9b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.200647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e13a-2be0-4953-9ef1-346c536d9b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.200915 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e13a-2be0-4953-9ef1-346c536d9b2d admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.202501 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5e13a-2be0-4953-9ef1-346c536d9b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:22.204416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5e13a-2be0-4953-9ef1-346c536d9b2d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:22.209036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:22.210497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:22.220293 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1359/2728] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:54:22.290354 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1370/2729] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:54:22 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:54:22.291551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:22.301570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b7895-e88d-4d01-a6ea-de41f7873617 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:22.306820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a609-058f-48f9-b297-3b016b864465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:22.307768 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a609-058f-48f9-b297-3b016b864465 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.308050 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a609-058f-48f9-b297-3b016b864465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.308324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a609-058f-48f9-b297-3b016b864465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.309042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3a609-058f-48f9-b297-3b016b864465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:22.311456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3a609-058f-48f9-b297-3b016b864465 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:22.321765 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1360/2730] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:22.325694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e13a-2be0-4953-9ef1-346c536d9b2d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:22.336345 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e13a-2be0-4953-9ef1-346c536d9b2d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:22.341006 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe9bb6-ff3b-41f8-bc92-20104c6f4386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:22.341659 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9bb6-ff3b-41f8-bc92-20104c6f4386 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.341942 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9bb6-ff3b-41f8-bc92-20104c6f4386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.342239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9bb6-ff3b-41f8-bc92-20104c6f4386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.342953 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9bb6-ff3b-41f8-bc92-20104c6f4386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:22.344552 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe9bb6-ff3b-41f8-bc92-20104c6f4386 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:22.354795 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1371/2731] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:54:22.359660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a609-058f-48f9-b297-3b016b864465 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:22.370324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a609-058f-48f9-b297-3b016b864465 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:22.375939 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:22.376819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.377103 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.377380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] PATH_INFO: `/v3/projects/f3bdd150da9d4f109717fbd4a46b477e/users/4f1e79cafd00439d859a736333d0caba/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.392957 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bdd150da9d4f109717fbd4a46b477e, user_id=4f1e79cafd00439d859a736333d0caba, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:22.395547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:22.479989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1361/2732] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:54:22 2022] PUT /identity/v3/projects/f3bdd150da9d4f109717fbd4a46b477e/users/4f1e79cafd00439d859a736333d0caba/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:22.485633 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5bdce-4263-4810-a279-f9e65c67e30f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.485924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5bdce-4263-4810-a279-f9e65c67e30f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.486233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5bdce-4263-4810-a279-f9e65c67e30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.505186 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-fcd5bdce-4263-4810-a279-f9e65c67e30f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:22.506443 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-fcd5bdce-4263-4810-a279-f9e65c67e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:22.566961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1372/2733] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:22.576857 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:22.578670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:22.615797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:22.639255 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d347cd-c959-48fe-9c58-992bd27970ee admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:22.643145 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:22.643727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:22.644006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:22.644276 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:22.653894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:22.655374 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:22.664932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1362/2734] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:23.913085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3717a12-6d18-4b68-ae65-f2887c4a9a8c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:23.913692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3717a12-6d18-4b68-ae65-f2887c4a9a8c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:23.913692 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3717a12-6d18-4b68-ae65-f2887c4a9a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:23.921747 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:23.944169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c3717a12-6d18-4b68-ae65-f2887c4a9a8c None None] MFA Rules not processed for user `4f1e79cafd00439d859a736333d0caba`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:23.945532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c3717a12-6d18-4b68-ae65-f2887c4a9a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:24.033648 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1373/2735] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:24.044722 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:24.047159 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:24.119821 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3a878-8754-44fa-8399-9a70faa83e96 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:24.124299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923d701-9146-4155-941b-5bf550de5c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:24.125126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923d701-9146-4155-941b-5bf550de5c76 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:24.125484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923d701-9146-4155-941b-5bf550de5c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:24.125798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923d701-9146-4155-941b-5bf550de5c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:24.135951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923d701-9146-4155-941b-5bf550de5c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:24.137828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923d701-9146-4155-941b-5bf550de5c76 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:24.148414 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1363/2736] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:25.836322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc899-a542-46d9-8e6f-2598278332dc None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:25.836839 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc899-a542-46d9-8e6f-2598278332dc None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:25.837475 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc899-a542-46d9-8e6f-2598278332dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:25.858136 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b94dc899-a542-46d9-8e6f-2598278332dc None None] MFA Rules not processed for user `4f1e79cafd00439d859a736333d0caba`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:25.859613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b94dc899-a542-46d9-8e6f-2598278332dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:25.866513 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1374/2737] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:26.240606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923d701-9146-4155-941b-5bf550de5c76 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:26.249967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923d701-9146-4155-941b-5bf550de5c76 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:26.253549 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:26.254206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:26.254596 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:26.255005 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:26.256761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:26.267253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:26.268699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:26.277036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1364/2738] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:27.078759 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc899-a542-46d9-8e6f-2598278332dc None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:27.080195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b94dc899-a542-46d9-8e6f-2598278332dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:27.158919 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc899-a542-46d9-8e6f-2598278332dc None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:27.164131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:27.164780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:27.165093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:27.165375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:27.167199 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:27.179117 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:27.180702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:27.191576 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1375/2739] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:30.130474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:30.131918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:30.146607 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47bf3d-401e-4333-942c-7eb1b1424e3d service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:30.152958 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:30.153838 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:30.154798 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:30.155131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] PATH_INFO: `/v3/users/298370ea294c4150be7de29116e49d73` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:30.158851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=298370ea294c4150be7de29116e49d73)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:30.158851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:30.309022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298370ea294c4150be7de29116e49d73'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.383088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298370ea294c4150be7de29116e49d73'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.390576 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298370ea294c4150be7de29116e49d73'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.391212 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298370ea294c4150be7de29116e49d73'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.403318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298370ea294c4150be7de29116e49d73'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.409834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1365/2740] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:30 2022] DELETE /identity/v3/users/298370ea294c4150be7de29116e49d73 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:30.665571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:30.680316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c0505-0a21-4c4b-9367-307958ece434 service placement] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:30.763197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:30.764403 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:30.764684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:30.764959 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] PATH_INFO: `/v3/projects/7994cefc64b44d1e92e94a9c8c1cca31` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:30.766180 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7994cefc64b44d1e92e94a9c8c1cca31)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:30.768152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:30.797163 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:30.869922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7994cefc64b44d1e92e94a9c8c1cca31', 'request_id': 'req-47adcffc-dac7-4b8c-ab82-be592e35c551'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.926191 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7994cefc64b44d1e92e94a9c8c1cca31', 'request_id': 'req-47adcffc-dac7-4b8c-ab82-be592e35c551'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.932133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7994cefc64b44d1e92e94a9c8c1cca31', 'request_id': 'req-47adcffc-dac7-4b8c-ab82-be592e35c551'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.943749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] The token cache is being invalidate because project 7994cefc64b44d1e92e94a9c8c1cca31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:30.944034 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.944654 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:30.946232 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1376/2741] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:30 2022] DELETE /identity/v3/projects/7994cefc64b44d1e92e94a9c8c1cca31 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:30.950181 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:30.952129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:30.965317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ab01e-64fb-4f9d-8475-6b1b3e9acfeb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:31.005542 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:31.033204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:31.034127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:31.034409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:31.034681 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] PATH_INFO: `/v3/users/56dae9ad029640369bc1eb6df53fc580` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:31.035869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dae9ad029640369bc1eb6df53fc580)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:31.037790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:31.255093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dae9ad029640369bc1eb6df53fc580'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.341775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dae9ad029640369bc1eb6df53fc580'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.357117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dae9ad029640369bc1eb6df53fc580'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.358403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dae9ad029640369bc1eb6df53fc580'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.370459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dae9ad029640369bc1eb6df53fc580'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.377245 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1366/2742] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:54:30 2022] DELETE /identity/v3/users/56dae9ad029640369bc1eb6df53fc580 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:31.675889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:31.677371 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:31.691565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adcffc-dac7-4b8c-ab82-be592e35c551 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:31.752908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:31.753770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:31.754077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:31.754360 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] PATH_INFO: `/v3/projects/cb259c97ad134414a2c2c6fe00602b5a` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:31.755541 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb259c97ad134414a2c2c6fe00602b5a)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:31.757440 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:31.864764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb259c97ad134414a2c2c6fe00602b5a', 'request_id': 'req-465d9475-0356-4e18-a7b2-a841463739f9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.937597 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb259c97ad134414a2c2c6fe00602b5a', 'request_id': 'req-465d9475-0356-4e18-a7b2-a841463739f9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.943928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb259c97ad134414a2c2c6fe00602b5a', 'request_id': 'req-465d9475-0356-4e18-a7b2-a841463739f9'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.956485 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] The token cache is being invalidate because project cb259c97ad134414a2c2c6fe00602b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:54:31.956778 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.957444 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-465d9475-0356-4e18-a7b2-a841463739f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:54:31.959031 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1377/2743] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:54:31 2022] DELETE /identity/v3/projects/cb259c97ad134414a2c2c6fe00602b5a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:54:41.373006 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:41.953262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:43.776173 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:54:43.777628 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:43.854485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f559ff-4b8d-4fb3-920e-2b27df178905 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:54:43.920644 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:54:43.921225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:43.921509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:43.921786 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:43.923663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:43.993230 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:54:43.994868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:54:44.004921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1367/2744] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:54:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:54:50.772627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f8e07-f007-4bd1-aff7-fdf03215e301 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:54:50.775730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f8e07-f007-4bd1-aff7-fdf03215e301 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:54:50.775730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f8e07-f007-4bd1-aff7-fdf03215e301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:54:50.791159 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-a60f8e07-f007-4bd1-aff7-fdf03215e301 None None] MFA Rules not processed for user `18d0bc67048c4bbb893f2589800c4535`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:54:50.792341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-a60f8e07-f007-4bd1-aff7-fdf03215e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:54:50.799523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1378/2745] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:54:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:54:53.999806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:00.786465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:41.858021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:55:41.859444 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:55:41.950336 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4556fe-4bf4-417b-8569-8c6dbbae7f1a service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:55:41.955253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:55:41.955890 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:55:41.956166 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:55:41.956441 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:55:41.958220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:55:41.969581 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:55:41.971155 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:55:41.981433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1368/2746] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:55:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:55:47.898745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fe08-8e2a-4ff1-b49c-3d56807f9c17 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:55:47.899231 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fe08-8e2a-4ff1-b49c-3d56807f9c17 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:55:47.899339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543fe08-8e2a-4ff1-b49c-3d56807f9c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:55:47.918093 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-c543fe08-8e2a-4ff1-b49c-3d56807f9c17 None None] MFA Rules not processed for user `4f1e79cafd00439d859a736333d0caba`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:55:47.919297 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c543fe08-8e2a-4ff1-b49c-3d56807f9c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:55:47.976248 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1379/2747] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:55:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:55:48.221372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:55:48.222834 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:55:48.279225 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57709b-7734-47c5-9da8-55b7be58adf2 service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:55:48.282882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:55:48.283522 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:55:48.283803 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:55:48.284080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:55:48.285827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:55:48.295757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:55:48.297179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:55:48.305742 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1369/2748] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:55:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:55:57.969452 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=25 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:58.301516 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=67 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:53.848642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543fe08-8e2a-4ff1-b49c-3d56807f9c17 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:56:53.850063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c543fe08-8e2a-4ff1-b49c-3d56807f9c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:56:53.906458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543fe08-8e2a-4ff1-b49c-3d56807f9c17 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:56:53.910073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:56:53.910710 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:56:53.910991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:56:53.911266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:56:53.913028 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:56:53.927195 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:56:53.928617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:56:53.940636 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1380/2749] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:56:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:00.114739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:00.116252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:00.182399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0d715-4f5d-470d-b201-df45d0b3359d service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:00.188707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:00.188707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:00.188707 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:00.189278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] PATH_INFO: `/v3/users/4f1e79cafd00439d859a736333d0caba` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:00.190176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1e79cafd00439d859a736333d0caba)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:00.192089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:00.358909 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1e79cafd00439d859a736333d0caba'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.431671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1e79cafd00439d859a736333d0caba'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.439606 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1e79cafd00439d859a736333d0caba'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.442248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1e79cafd00439d859a736333d0caba'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.452483 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-25851d1c-69de-4804-b370-7001a5046cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1e79cafd00439d859a736333d0caba'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.458583 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1370/2750] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:57:00 2022] DELETE /identity/v3/users/4f1e79cafd00439d859a736333d0caba => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:00.679427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:00.691428 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2fd0-3606-405b-93fb-2a7e3a4f84e4 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:00.748430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:00.749291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:00.749570 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:00.749844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] PATH_INFO: `/v3/projects/f3bdd150da9d4f109717fbd4a46b477e` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:00.751703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bdd150da9d4f109717fbd4a46b477e)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:00.753612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:00.870506 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bdd150da9d4f109717fbd4a46b477e', 'request_id': 'req-83c41dca-7da9-435f-8236-082679c0c432'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.962875 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bdd150da9d4f109717fbd4a46b477e', 'request_id': 'req-83c41dca-7da9-435f-8236-082679c0c432'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.968992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bdd150da9d4f109717fbd4a46b477e', 'request_id': 'req-83c41dca-7da9-435f-8236-082679c0c432'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.980895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] The token cache is being invalidate because project f3bdd150da9d4f109717fbd4a46b477e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:57:00.981233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.981879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83c41dca-7da9-435f-8236-082679c0c432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:00.983437 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1381/2751] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:57:00 2022] DELETE /identity/v3/projects/f3bdd150da9d4f109717fbd4a46b477e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:00.989325 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1973-93d8-46ff-96c7-d9c6b8158a80 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:00.989630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1973-93d8-46ff-96c7-d9c6b8158a80 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:00.989908 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a1973-93d8-46ff-96c7-d9c6b8158a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.007273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d14a1973-93d8-46ff-96c7-d9c6b8158a80 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:01.008489 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d14a1973-93d8-46ff-96c7-d9c6b8158a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:01.069513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1371/2752] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:01.080016 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e070d1-2fcf-4b40-9f0a-9d3e8451577b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.080326 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e070d1-2fcf-4b40-9f0a-9d3e8451577b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.080605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e070d1-2fcf-4b40-9f0a-9d3e8451577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.099702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-99e070d1-2fcf-4b40-9f0a-9d3e8451577b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:01.100887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-99e070d1-2fcf-4b40-9f0a-9d3e8451577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:01.108801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1382/2753] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:01.113300 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a1973-93d8-46ff-96c7-d9c6b8158a80 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:01.122871 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a1973-93d8-46ff-96c7-d9c6b8158a80 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:01.128397 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:01.129222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.129366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.129592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.130366 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:57:01.130676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:01.132258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:01.144758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1372/2754] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:57:01.149251 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e070d1-2fcf-4b40-9f0a-9d3e8451577b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:01.158940 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e070d1-2fcf-4b40-9f0a-9d3e8451577b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:01.163965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9e5a6-cb02-41d8-9eb3-4eeb6a3ce043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:01.164621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e5a6-cb02-41d8-9eb3-4eeb6a3ce043 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.164900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e5a6-cb02-41d8-9eb3-4eeb6a3ce043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.165218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9e5a6-cb02-41d8-9eb3-4eeb6a3ce043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.166260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9e5a6-cb02-41d8-9eb3-4eeb6a3ce043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:01.170118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9e5a6-cb02-41d8-9eb3-4eeb6a3ce043 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:01.268060 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1383/2755] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:57:01 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:57:01.272052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:01.282660 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4dd95-b33b-4e2c-9aea-b4204305d95f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:01.286408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:01.341079 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aae78-89f3-4b04-8b21-ab9b9ed4e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:01.341816 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aae78-89f3-4b04-8b21-ab9b9ed4e976 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.342150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aae78-89f3-4b04-8b21-ab9b9ed4e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.342548 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aae78-89f3-4b04-8b21-ab9b9ed4e976 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.343237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aae78-89f3-4b04-8b21-ab9b9ed4e976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:01.345231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aae78-89f3-4b04-8b21-ab9b9ed4e976 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:01.413938 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1373/2756] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:57:01 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:01.423879 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9e5a6-cb02-41d8-9eb3-4eeb6a3ce043 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:01.430489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:01.434189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9e5a6-cb02-41d8-9eb3-4eeb6a3ce043 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:01.439619 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec70d1-c94b-4c12-ac2a-cc198e357dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:01.440265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec70d1-c94b-4c12-ac2a-cc198e357dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.440547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec70d1-c94b-4c12-ac2a-cc198e357dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.440824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec70d1-c94b-4c12-ac2a-cc198e357dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.441544 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec70d1-c94b-4c12-ac2a-cc198e357dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:01.443166 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec70d1-c94b-4c12-ac2a-cc198e357dd4 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:01.453675 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1384/2757] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:01.457882 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aae78-89f3-4b04-8b21-ab9b9ed4e976 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:01.467967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aae78-89f3-4b04-8b21-ab9b9ed4e976 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:01.472971 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd763e8-0428-4f9d-8355-0fdda04db2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:01.473616 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd763e8-0428-4f9d-8355-0fdda04db2df admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.473897 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd763e8-0428-4f9d-8355-0fdda04db2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.474204 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd763e8-0428-4f9d-8355-0fdda04db2df admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.474978 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd763e8-0428-4f9d-8355-0fdda04db2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:01.476554 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd763e8-0428-4f9d-8355-0fdda04db2df admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:01.487316 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1374/2758] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:01.491374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec70d1-c94b-4c12-ac2a-cc198e357dd4 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:01.501828 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec70d1-c94b-4c12-ac2a-cc198e357dd4 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:01.507903 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:01.508772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.509046 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.509310 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] PATH_INFO: `/v3/projects/d6448a906a594b6183ad55b7c49b24ff/users/9360bc198e484dd0bdcd9239f4510b0a/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.525050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6448a906a594b6183ad55b7c49b24ff, user_id=9360bc198e484dd0bdcd9239f4510b0a, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:01.527429 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:01.596805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1385/2759] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:01 2022] PUT /identity/v3/projects/d6448a906a594b6183ad55b7c49b24ff/users/9360bc198e484dd0bdcd9239f4510b0a/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:01.602147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d587b-6547-4797-a76f-8e11598ebec4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.602432 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d587b-6547-4797-a76f-8e11598ebec4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.602706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d587b-6547-4797-a76f-8e11598ebec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.621285 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6c3d587b-6547-4797-a76f-8e11598ebec4 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:01.622501 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6c3d587b-6547-4797-a76f-8e11598ebec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:01.682990 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1375/2760] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:01.693210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:01.694899 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:01.753194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca2546-3f13-4ffe-9977-ff18a72c5c7d admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:01.756805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e2632-f5b2-4c1d-980a-3cc861230408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:01.757673 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2632-f5b2-4c1d-980a-3cc861230408 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:01.757963 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2632-f5b2-4c1d-980a-3cc861230408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:01.758262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e2632-f5b2-4c1d-980a-3cc861230408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:01.767983 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e2632-f5b2-4c1d-980a-3cc861230408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:01.769470 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e2632-f5b2-4c1d-980a-3cc861230408 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:01.778891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1386/2761] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:04.939736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d587b-6547-4797-a76f-8e11598ebec4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:04.942769 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6c3d587b-6547-4797-a76f-8e11598ebec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:05.050314 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d587b-6547-4797-a76f-8e11598ebec4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:05.054433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:05.058744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:05.058744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:05.058744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:05.060282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:05.140948 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:05.179847 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:05.181335 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:05.199735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1376/2762] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:07.137389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea780ad-51c4-4d32-839f-536fa80dfb4c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:07.137993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea780ad-51c4-4d32-839f-536fa80dfb4c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:07.137993 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea780ad-51c4-4d32-839f-536fa80dfb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:07.170845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0ea780ad-51c4-4d32-839f-536fa80dfb4c None None] MFA Rules not processed for user `9360bc198e484dd0bdcd9239f4510b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:07.172085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0ea780ad-51c4-4d32-839f-536fa80dfb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:07.249551 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1387/2763] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:07.254811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:07.265237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab993f7f-0ef7-4e27-b078-6f760e87bdcd service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:07.270214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c35d9-a997-440b-846f-541613baf89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:07.270869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c35d9-a997-440b-846f-541613baf89b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:07.271148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c35d9-a997-440b-846f-541613baf89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:07.271659 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c35d9-a997-440b-846f-541613baf89b admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:07.272372 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c35d9-a997-440b-846f-541613baf89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:07.274448 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c35d9-a997-440b-846f-541613baf89b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:07.377069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1377/2764] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:57:07 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:07.381301 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea780ad-51c4-4d32-839f-536fa80dfb4c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:07.393233 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea780ad-51c4-4d32-839f-536fa80dfb4c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:07.451713 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dadae-1e49-424f-a536-6df6de78007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:07.452303 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dadae-1e49-424f-a536-6df6de78007a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:07.452580 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dadae-1e49-424f-a536-6df6de78007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:07.452849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dadae-1e49-424f-a536-6df6de78007a admin admin] PATH_INFO: `/v3/users` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:07.454078 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dadae-1e49-424f-a536-6df6de78007a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:07.455987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dadae-1e49-424f-a536-6df6de78007a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:07.463561 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:07.556207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1388/2765] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:57:07 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:57:07.560180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c35d9-a997-440b-846f-541613baf89b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:07.571382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c35d9-a997-440b-846f-541613baf89b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:07.576043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5cfd9-834b-43be-b09d-1e1ad5072f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:07.576687 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5cfd9-834b-43be-b09d-1e1ad5072f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:07.576965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5cfd9-834b-43be-b09d-1e1ad5072f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:07.577236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5cfd9-834b-43be-b09d-1e1ad5072f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:07.578072 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5cfd9-834b-43be-b09d-1e1ad5072f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:07.580313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5cfd9-834b-43be-b09d-1e1ad5072f21 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:07.592002 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1378/2766] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:07.596140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dadae-1e49-424f-a536-6df6de78007a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:07.606157 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dadae-1e49-424f-a536-6df6de78007a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:07.611148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd47c0-31a1-4d9d-b2b0-52073b7be735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:07.611992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd47c0-31a1-4d9d-b2b0-52073b7be735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:07.612299 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd47c0-31a1-4d9d-b2b0-52073b7be735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:07.612578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd47c0-31a1-4d9d-b2b0-52073b7be735 admin admin] PATH_INFO: `/v3/projects/aaa42dd66f804bda843aaea13937dcaf/users/13095991810c4229931ea77abfc3cd52/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:07.627928 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd47c0-31a1-4d9d-b2b0-52073b7be735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa42dd66f804bda843aaea13937dcaf, user_id=13095991810c4229931ea77abfc3cd52, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:07.630889 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd47c0-31a1-4d9d-b2b0-52073b7be735 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:07.701236 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1389/2767] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:07 2022] PUT /identity/v3/projects/aaa42dd66f804bda843aaea13937dcaf/users/13095991810c4229931ea77abfc3cd52/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:07.706218 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5cfd9-834b-43be-b09d-1e1ad5072f21 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:07.716035 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5cfd9-834b-43be-b09d-1e1ad5072f21 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:07.777423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17921e8b-6235-434e-9a4e-02dd086c62f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:07.778128 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921e8b-6235-434e-9a4e-02dd086c62f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:07.778435 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921e8b-6235-434e-9a4e-02dd086c62f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:07.778706 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17921e8b-6235-434e-9a4e-02dd086c62f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:07.779456 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17921e8b-6235-434e-9a4e-02dd086c62f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:07.781380 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17921e8b-6235-434e-9a4e-02dd086c62f3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:07.792291 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1379/2768] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:07.796424 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd47c0-31a1-4d9d-b2b0-52073b7be735 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:07.807432 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd47c0-31a1-4d9d-b2b0-52073b7be735 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:07.812151 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:07.813557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:07.814430 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:07.814709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] PATH_INFO: `/v3/projects/aaa42dd66f804bda843aaea13937dcaf/users/13095991810c4229931ea77abfc3cd52/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:07.816708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa42dd66f804bda843aaea13937dcaf, user_id=13095991810c4229931ea77abfc3cd52, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:07.819368 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:07.831398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1390/2769] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:07 2022] PUT /identity/v3/projects/aaa42dd66f804bda843aaea13937dcaf/users/13095991810c4229931ea77abfc3cd52/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:13.464345 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566805e5-61d8-4aa2-b103-2fc6e452d565 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:13.464876 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566805e5-61d8-4aa2-b103-2fc6e452d565 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:13.465026 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566805e5-61d8-4aa2-b103-2fc6e452d565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:13.501127 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-566805e5-61d8-4aa2-b103-2fc6e452d565 None None] MFA Rules not processed for user `13095991810c4229931ea77abfc3cd52`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:13.502499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-566805e5-61d8-4aa2-b103-2fc6e452d565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:13.586410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1380/2770] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:13.599565 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:13.601272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:13.683218 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008986db-7809-4b99-bc32-2aebfa3ae925 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:13.686844 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7d46c2766b4481963adefebea94c09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:13.687482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:13.687837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:13.688204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:13.743862 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:13.745244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:13.754902 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1391/2771] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:13.989845 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a093b-de05-4cf7-bba4-3000a6e95e9b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:13.990963 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a093b-de05-4cf7-bba4-3000a6e95e9b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:13.990963 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a093b-de05-4cf7-bba4-3000a6e95e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:14.012808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:14.050275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c27a093b-de05-4cf7-bba4-3000a6e95e9b None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:14.051498 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c27a093b-de05-4cf7-bba4-3000a6e95e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:14.118773 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1381/2772] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:57:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:14.247105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:14.248598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:14.304469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:14.341962 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7baa7d-3726-4229-8b19-5b867c069c90 service glance] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:14.348911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99527af3-a95e-43ab-a0d8-4854ca2f967e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:14.349583 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99527af3-a95e-43ab-a0d8-4854ca2f967e service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:14.349859 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99527af3-a95e-43ab-a0d8-4854ca2f967e service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:14.350161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99527af3-a95e-43ab-a0d8-4854ca2f967e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:14.358849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99527af3-a95e-43ab-a0d8-4854ca2f967e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:14.361070 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99527af3-a95e-43ab-a0d8-4854ca2f967e service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:14.369422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1392/2773] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:57:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:57:24.115880 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=37 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:24.366058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=19 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:24.978715 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25a503-c100-4c22-b206-480a3f29bb87 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:24.979001 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25a503-c100-4c22-b206-480a3f29bb87 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:24.979279 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25a503-c100-4c22-b206-480a3f29bb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:24.998062 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1b25a503-c100-4c22-b206-480a3f29bb87 None None] MFA Rules not processed for user `9360bc198e484dd0bdcd9239f4510b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:24.999260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1b25a503-c100-4c22-b206-480a3f29bb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:25.006393 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1382/2774] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:28.404322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d05d78-e5a1-49f3-a2e4-74ec629c1217 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:28.404887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d05d78-e5a1-49f3-a2e4-74ec629c1217 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:28.404887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d05d78-e5a1-49f3-a2e4-74ec629c1217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:28.425115 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-59d05d78-e5a1-49f3-a2e4-74ec629c1217 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:28.426359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-59d05d78-e5a1-49f3-a2e4-74ec629c1217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:28.434137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1393/2775] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:57:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:28.446922 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25a503-c100-4c22-b206-480a3f29bb87 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:28.460484 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25a503-c100-4c22-b206-480a3f29bb87 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:28.466348 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:28.466989 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:28.467265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:28.467538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:28.476615 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:28.478417 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:28.487370 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1383/2776] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:57:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 22:57:30.709482 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d05d78-e5a1-49f3-a2e4-74ec629c1217 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:30.766244 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d05d78-e5a1-49f3-a2e4-74ec629c1217 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:30.770634 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:30.771341 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:30.771706 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:30.771965 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:30.774447 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:30.849946 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:30.851457 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:30.864335 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1394/2777] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:35.139167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:35.140653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:35.155666 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b3649-a4e7-4ba3-a7c2-e91c493a5728 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:35.161727 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:35.162656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:35.162936 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:35.163206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] PATH_INFO: `/v3/users/18d0bc67048c4bbb893f2589800c4535` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:35.164415 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d0bc67048c4bbb893f2589800c4535)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:35.166698 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:35.351299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d0bc67048c4bbb893f2589800c4535'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:35.408459 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d0bc67048c4bbb893f2589800c4535'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:35.417019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d0bc67048c4bbb893f2589800c4535'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:35.424497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d0bc67048c4bbb893f2589800c4535'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:35.458637 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0f5ec90f-bb34-4749-8fd8-765201dde021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d0bc67048c4bbb893f2589800c4535'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:35.467075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1384/2778] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:57:35 2022] DELETE /identity/v3/users/18d0bc67048c4bbb893f2589800c4535 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:36.078051 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:36.090111 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f967e-c5a7-4190-a2e8-499fd52fe58f service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:36.167918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:36.169349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.169791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.170260 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] PATH_INFO: `/v3/projects/89ab9bb65d8a44348faf97c7d19d8c84` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:36.171681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ab9bb65d8a44348faf97c7d19d8c84)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:36.173948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:36.307279 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:36.310827 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ab9bb65d8a44348faf97c7d19d8c84', 'request_id': 'req-496fece2-6e51-44e7-9e85-c198f359e984'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:36.378484 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ab9bb65d8a44348faf97c7d19d8c84', 'request_id': 'req-496fece2-6e51-44e7-9e85-c198f359e984'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:36.384494 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ab9bb65d8a44348faf97c7d19d8c84', 'request_id': 'req-496fece2-6e51-44e7-9e85-c198f359e984'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:36.396291 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] The token cache is being invalidate because project 89ab9bb65d8a44348faf97c7d19d8c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:57:36.396578 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:36.397216 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-496fece2-6e51-44e7-9e85-c198f359e984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:36.398787 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1395/2779] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:57:36 2022] DELETE /identity/v3/projects/89ab9bb65d8a44348faf97c7d19d8c84 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:36.404386 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47441-1f46-40b4-824a-7c286719645e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.405561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47441-1f46-40b4-824a-7c286719645e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.405561 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f47441-1f46-40b4-824a-7c286719645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:36.424849 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-00f47441-1f46-40b4-824a-7c286719645e None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:36.426081 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-00f47441-1f46-40b4-824a-7c286719645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:36.488189 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1385/2780] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:36.496027 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053870e3-036b-4a99-897a-99b44b9a8375 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.496351 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053870e3-036b-4a99-897a-99b44b9a8375 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.496630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053870e3-036b-4a99-897a-99b44b9a8375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:36.515269 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-053870e3-036b-4a99-897a-99b44b9a8375 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:36.516670 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-053870e3-036b-4a99-897a-99b44b9a8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:36.524805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1396/2781] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:36.529027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f47441-1f46-40b4-824a-7c286719645e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:36.539242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f47441-1f46-40b4-824a-7c286719645e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:36.544805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:36.545148 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.545439 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.545721 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:36.546566 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:57:36.546942 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:36.548668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:36.567304 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1386/2782] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:57:36.573557 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053870e3-036b-4a99-897a-99b44b9a8375 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:36.579149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053870e3-036b-4a99-897a-99b44b9a8375 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:36.584276 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9b78-c228-4bc6-b5ea-fcd405bcc45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:36.585110 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b78-c228-4bc6-b5ea-fcd405bcc45a admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.585397 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b78-c228-4bc6-b5ea-fcd405bcc45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.585677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b78-c228-4bc6-b5ea-fcd405bcc45a admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:36.586423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba9b78-c228-4bc6-b5ea-fcd405bcc45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:36.588652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba9b78-c228-4bc6-b5ea-fcd405bcc45a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:36.707726 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1397/2783] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:57:36 2022] POST /identity/v3/projects => generated 401 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:36.712465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:36.724060 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325df92-9865-4cc5-bbc0-2877a12d5d86 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:36.766692 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:36.785217 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009b81d-6930-47be-8894-d2f6f6abdc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:36.788852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b81d-6930-47be-8894-d2f6f6abdc10 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.788852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b81d-6930-47be-8894-d2f6f6abdc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.788852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b81d-6930-47be-8894-d2f6f6abdc10 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:36.788852 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009b81d-6930-47be-8894-d2f6f6abdc10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:36.789253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009b81d-6930-47be-8894-d2f6f6abdc10 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:36.894604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1387/2784] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:57:36 2022] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:36.898987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9b78-c228-4bc6-b5ea-fcd405bcc45a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:36.911325 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9b78-c228-4bc6-b5ea-fcd405bcc45a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:36.915242 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f03ad-39b9-4ecb-bc43-9183a9f06df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:36.916179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f03ad-39b9-4ecb-bc43-9183a9f06df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.916461 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f03ad-39b9-4ecb-bc43-9183a9f06df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.916734 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f03ad-39b9-4ecb-bc43-9183a9f06df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:36.917463 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f03ad-39b9-4ecb-bc43-9183a9f06df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:36.919131 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f03ad-39b9-4ecb-bc43-9183a9f06df7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:36.930612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1398/2785] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:36.934758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009b81d-6930-47be-8894-d2f6f6abdc10 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:36.945761 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009b81d-6930-47be-8894-d2f6f6abdc10 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:36.950804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4324dae-61ae-4aa2-b223-61654a36a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:36.951515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4324dae-61ae-4aa2-b223-61654a36a436 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.951797 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4324dae-61ae-4aa2-b223-61654a36a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.952071 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4324dae-61ae-4aa2-b223-61654a36a436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:36.952812 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4324dae-61ae-4aa2-b223-61654a36a436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:36.955129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4324dae-61ae-4aa2-b223-61654a36a436 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:36.968669 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1388/2786] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:36.973495 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f03ad-39b9-4ecb-bc43-9183a9f06df7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:36.984308 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f03ad-39b9-4ecb-bc43-9183a9f06df7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:36.990369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6b485-bf31-49f9-9acd-fb88b5fb9a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:36.990369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6b485-bf31-49f9-9acd-fb88b5fb9a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:36.990369 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6b485-bf31-49f9-9acd-fb88b5fb9a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:36.990695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6b485-bf31-49f9-9acd-fb88b5fb9a80 admin admin] PATH_INFO: `/v3/projects/538e7cc5c88d435f8b4f066b818d8963/users/5ff9db1780b44fb1bf7719f41d3c8630/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.005375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6b485-bf31-49f9-9acd-fb88b5fb9a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538e7cc5c88d435f8b4f066b818d8963, user_id=5ff9db1780b44fb1bf7719f41d3c8630, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:37.008113 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6b485-bf31-49f9-9acd-fb88b5fb9a80 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:37.071894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1399/2787] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:36 2022] PUT /identity/v3/projects/538e7cc5c88d435f8b4f066b818d8963/users/5ff9db1780b44fb1bf7719f41d3c8630/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:37.083541 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0391857-d8e6-4fa9-b410-1b42b44837c8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.083826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0391857-d8e6-4fa9-b410-1b42b44837c8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.084105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0391857-d8e6-4fa9-b410-1b42b44837c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.109932 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c0391857-d8e6-4fa9-b410-1b42b44837c8 None None] MFA Rules not processed for user `5ff9db1780b44fb1bf7719f41d3c8630`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:37.111202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c0391857-d8e6-4fa9-b410-1b42b44837c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:37.177574 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1389/2788] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:37.181985 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6b485-bf31-49f9-9acd-fb88b5fb9a80 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:37.244210 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6b485-bf31-49f9-9acd-fb88b5fb9a80 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:37.248918 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5b6f8-8207-494e-8cfe-05c748190b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:37.249574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5b6f8-8207-494e-8cfe-05c748190b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.249855 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5b6f8-8207-494e-8cfe-05c748190b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.250174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5b6f8-8207-494e-8cfe-05c748190b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.250949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5b6f8-8207-494e-8cfe-05c748190b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:37.252843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5b6f8-8207-494e-8cfe-05c748190b23 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:37.336127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1400/2789] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:57:37 2022] POST /identity/v3/projects => generated 401 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:37.340056 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0391857-d8e6-4fa9-b410-1b42b44837c8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:37.351531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0391857-d8e6-4fa9-b410-1b42b44837c8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:37.408306 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67c64-ccfe-46ee-8ac4-323eaa30b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:37.408996 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67c64-ccfe-46ee-8ac4-323eaa30b028 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.409243 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67c64-ccfe-46ee-8ac4-323eaa30b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.409515 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b67c64-ccfe-46ee-8ac4-323eaa30b028 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.410237 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b67c64-ccfe-46ee-8ac4-323eaa30b028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:37.412135 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b67c64-ccfe-46ee-8ac4-323eaa30b028 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:37.482330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1390/2790] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:57:37 2022] POST /identity/v3/users => generated 307 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:37.486572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5b6f8-8207-494e-8cfe-05c748190b23 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:37.496781 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5b6f8-8207-494e-8cfe-05c748190b23 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:37.501934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c747e-fbdc-4809-ada3-78aaf499e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:37.502615 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c747e-fbdc-4809-ada3-78aaf499e076 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.502900 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c747e-fbdc-4809-ada3-78aaf499e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.503174 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c747e-fbdc-4809-ada3-78aaf499e076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.503895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c747e-fbdc-4809-ada3-78aaf499e076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:37.505480 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c747e-fbdc-4809-ada3-78aaf499e076 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:37.516047 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1401/2791] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:37.520946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67c64-ccfe-46ee-8ac4-323eaa30b028 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:37.530806 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b67c64-ccfe-46ee-8ac4-323eaa30b028 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:37.535935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16a525-7a06-49d6-8c93-671cb72b62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:37.536839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16a525-7a06-49d6-8c93-671cb72b62ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.537116 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16a525-7a06-49d6-8c93-671cb72b62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.537388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16a525-7a06-49d6-8c93-671cb72b62ea admin admin] PATH_INFO: `/v3/projects/7559dadce92e47fbbf75e4fda467d32f/users/652b4b402f6e43dca64f3aa12e36b51f/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.552014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16a525-7a06-49d6-8c93-671cb72b62ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7559dadce92e47fbbf75e4fda467d32f, user_id=652b4b402f6e43dca64f3aa12e36b51f, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:37.554670 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16a525-7a06-49d6-8c93-671cb72b62ea admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:37.619369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1391/2792] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:37 2022] PUT /identity/v3/projects/7559dadce92e47fbbf75e4fda467d32f/users/652b4b402f6e43dca64f3aa12e36b51f/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:37.623211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c747e-fbdc-4809-ada3-78aaf499e076 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:37.634118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c747e-fbdc-4809-ada3-78aaf499e076 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:37.675858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:37.691045 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cc887-d67b-48d2-879b-545325bfad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:37.691698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc887-d67b-48d2-879b-545325bfad9d admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.691973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc887-d67b-48d2-879b-545325bfad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.692296 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc887-d67b-48d2-879b-545325bfad9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.693009 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cc887-d67b-48d2-879b-545325bfad9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:37.694625 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cc887-d67b-48d2-879b-545325bfad9d admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:37.705211 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1402/2793] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:37.709009 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16a525-7a06-49d6-8c93-671cb72b62ea admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:37.719167 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16a525-7a06-49d6-8c93-671cb72b62ea admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:37.724123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:37.724985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.725262 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.725540 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] PATH_INFO: `/v3/projects/7559dadce92e47fbbf75e4fda467d32f/users/652b4b402f6e43dca64f3aa12e36b51f/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.727570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7559dadce92e47fbbf75e4fda467d32f, user_id=652b4b402f6e43dca64f3aa12e36b51f, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:37.730198 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:37.736638 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:37.741041 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1392/2794] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:37 2022] PUT /identity/v3/projects/7559dadce92e47fbbf75e4fda467d32f/users/652b4b402f6e43dca64f3aa12e36b51f/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:37.751581 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fed34-358c-413c-b153-7b04328db10a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.751873 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fed34-358c-413c-b153-7b04328db10a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.752172 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fed34-358c-413c-b153-7b04328db10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.778947 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b39fed34-358c-413c-b153-7b04328db10a None None] MFA Rules not processed for user `652b4b402f6e43dca64f3aa12e36b51f`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:37.780150 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b39fed34-358c-413c-b153-7b04328db10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:37.848001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1403/2795] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:37.858531 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:37.860275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:37.918425 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe22ac8-f703-4afc-a008-2faf9eceecd9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:37.922176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:37.923330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:37.923611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:37.923888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:37.932921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:37.934433 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:37.944506 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1393/2796] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:38.202757 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fed34-358c-413c-b153-7b04328db10a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:38.212265 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fed34-358c-413c-b153-7b04328db10a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:38.215838 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:38.217700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:38.217700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:38.217700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:38.273215 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:38.274807 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:38.284057 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1404/2797] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:39.295117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:39.296604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:39.355962 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ab07-0db6-4156-95ef-69c7ddc5b75a service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:39.359633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:39.360273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:39.360605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:39.360913 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:39.362679 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:39.372043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:39.373457 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:39.383043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1394/2798] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:40.179886 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:40.181593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:40.263667 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:40.272087 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec3e1c-1751-44df-8e09-1c29e8f12581 service cinder] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:40.278152 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de5b3e-b29d-4355-b1b2-1cd4c082ee12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:40.278921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de5b3e-b29d-4355-b1b2-1cd4c082ee12 service nova] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:40.279272 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de5b3e-b29d-4355-b1b2-1cd4c082ee12 service nova] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:40.279614 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de5b3e-b29d-4355-b1b2-1cd4c082ee12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:40.281779 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-e1de5b3e-b29d-4355-b1b2-1cd4c082ee12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:40.296939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de5b3e-b29d-4355-b1b2-1cd4c082ee12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:40.300040 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de5b3e-b29d-4355-b1b2-1cd4c082ee12 service nova] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:40.313127 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1405/2799] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:43.319205 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:43.385344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62a40d-fc2a-4584-8051-52bce27ddcd1 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:43.389840 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:43.390738 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:43.391016 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:43.391288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] PATH_INFO: `/v3/users/5ff9db1780b44fb1bf7719f41d3c8630` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:43.393090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff9db1780b44fb1bf7719f41d3c8630)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:43.395027 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:43.599126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff9db1780b44fb1bf7719f41d3c8630'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:43.600827 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:43.671278 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff9db1780b44fb1bf7719f41d3c8630'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:43.679045 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff9db1780b44fb1bf7719f41d3c8630'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:43.683744 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff9db1780b44fb1bf7719f41d3c8630'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:43.692474 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff9db1780b44fb1bf7719f41d3c8630'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:43.698656 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1395/2800] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:57:43 2022] DELETE /identity/v3/users/5ff9db1780b44fb1bf7719f41d3c8630 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:43.703010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754bf46-8f0b-4377-9c1c-ffb8dc56acec None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:43.703518 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754bf46-8f0b-4377-9c1c-ffb8dc56acec None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:43.703656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754bf46-8f0b-4377-9c1c-ffb8dc56acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:43.721284 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b754bf46-8f0b-4377-9c1c-ffb8dc56acec None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:43.722508 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b754bf46-8f0b-4377-9c1c-ffb8dc56acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:43.785072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1406/2801] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:43.794901 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:43.796277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:43.853465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738238f7-3224-4657-9cde-35eb1e99d47f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:43.856927 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90751327-4751-4071-9f07-7b91b04a5281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:43.857558 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751327-4751-4071-9f07-7b91b04a5281 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:43.857835 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751327-4751-4071-9f07-7b91b04a5281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:43.858140 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751327-4751-4071-9f07-7b91b04a5281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:43.867614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90751327-4751-4071-9f07-7b91b04a5281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:43.869040 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90751327-4751-4071-9f07-7b91b04a5281 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:43.880176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1396/2802] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:44.353178 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754bf46-8f0b-4377-9c1c-ffb8dc56acec None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:44.355262 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b754bf46-8f0b-4377-9c1c-ffb8dc56acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:44.378777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754bf46-8f0b-4377-9c1c-ffb8dc56acec None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:44.387748 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:44.388693 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:44.388914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:44.389189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] PATH_INFO: `/v3/projects/538e7cc5c88d435f8b4f066b818d8963` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:44.390413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538e7cc5c88d435f8b4f066b818d8963)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:44.392338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:44.505184 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538e7cc5c88d435f8b4f066b818d8963', 'request_id': 'req-8ee7e036-e129-404d-9b05-49ad8fe42d54'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.579010 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538e7cc5c88d435f8b4f066b818d8963', 'request_id': 'req-8ee7e036-e129-404d-9b05-49ad8fe42d54'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.584729 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538e7cc5c88d435f8b4f066b818d8963', 'request_id': 'req-8ee7e036-e129-404d-9b05-49ad8fe42d54'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.596664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] The token cache is being invalidate because project 538e7cc5c88d435f8b4f066b818d8963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:57:44.596943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.597569 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.599165 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1407/2803] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:57:44 2022] DELETE /identity/v3/projects/538e7cc5c88d435f8b4f066b818d8963 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:44.603093 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90751327-4751-4071-9f07-7b91b04a5281 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:44.613378 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90751327-4751-4071-9f07-7b91b04a5281 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:44.668283 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:44.669075 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:44.669354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:44.669630 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] PATH_INFO: `/v3/users/652b4b402f6e43dca64f3aa12e36b51f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:44.670836 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=652b4b402f6e43dca64f3aa12e36b51f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:44.672735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:44.832853 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652b4b402f6e43dca64f3aa12e36b51f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.887911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652b4b402f6e43dca64f3aa12e36b51f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.895986 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652b4b402f6e43dca64f3aa12e36b51f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.896625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652b4b402f6e43dca64f3aa12e36b51f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.901794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:44.909899 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652b4b402f6e43dca64f3aa12e36b51f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:44.916129 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1397/2804] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:57:44 2022] DELETE /identity/v3/users/652b4b402f6e43dca64f3aa12e36b51f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:45.366032 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:45.368921 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:45.383386 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e036-e129-404d-9b05-49ad8fe42d54 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:45.449061 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:45.449976 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:45.450419 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:45.450607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] PATH_INFO: `/v3/projects/7559dadce92e47fbbf75e4fda467d32f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:45.451810 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7559dadce92e47fbbf75e4fda467d32f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:45.453728 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:45.475666 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:45.478222 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:45.479787 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:45.556193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aaae4-d419-4815-ba57-1a772e7d1f3f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:45.561699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45a520-dd69-45e5-bd73-87a5792eea1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55b3fcbfb08544d482bd0bea4b3d3f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:45.562363 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a520-dd69-45e5-bd73-87a5792eea1a service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:45.562636 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a520-dd69-45e5-bd73-87a5792eea1a service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:45.562911 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45a520-dd69-45e5-bd73-87a5792eea1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:45.565509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ff45a520-dd69-45e5-bd73-87a5792eea1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:45.573531 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7559dadce92e47fbbf75e4fda467d32f', 'request_id': 'req-de19262e-97ba-442c-8b48-2e5bb820e6eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:45.577895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a520-dd69-45e5-bd73-87a5792eea1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:45.585481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45a520-dd69-45e5-bd73-87a5792eea1a service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:45.590201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1398/2805] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:57:45.675564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7559dadce92e47fbbf75e4fda467d32f', 'request_id': 'req-de19262e-97ba-442c-8b48-2e5bb820e6eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:45.681722 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7559dadce92e47fbbf75e4fda467d32f', 'request_id': 'req-de19262e-97ba-442c-8b48-2e5bb820e6eb'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:45.693549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] The token cache is being invalidate because project 7559dadce92e47fbbf75e4fda467d32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:57:45.693774 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:45.694459 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-de19262e-97ba-442c-8b48-2e5bb820e6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:45.696015 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1408/2806] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:57:45 2022] DELETE /identity/v3/projects/7559dadce92e47fbbf75e4fda467d32f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:45.700837 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36038a79-382c-47f1-8635-9357e0f9a4bc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:45.701312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36038a79-382c-47f1-8635-9357e0f9a4bc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:45.701539 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36038a79-382c-47f1-8635-9357e0f9a4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:45.719983 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-36038a79-382c-47f1-8635-9357e0f9a4bc None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:45.723248 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-36038a79-382c-47f1-8635-9357e0f9a4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:45.780905 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1399/2807] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:57:45.791058 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4726c7-0a07-44c9-a027-aa55418f796f None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:45.792469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4726c7-0a07-44c9-a027-aa55418f796f None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:45.792469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4726c7-0a07-44c9-a027-aa55418f796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:45.810690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7f4726c7-0a07-44c9-a027-aa55418f796f None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:45.811894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7f4726c7-0a07-44c9-a027-aa55418f796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:45.819851 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1409/2808] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:45.824141 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36038a79-382c-47f1-8635-9357e0f9a4bc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:45.833965 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36038a79-382c-47f1-8635-9357e0f9a4bc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:45.838626 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:45.839270 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:45.839557 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:45.839832 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:45.840551 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:57:45.840859 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:45.842491 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:45.854808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1400/2809] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 22:57:45.858916 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4726c7-0a07-44c9-a027-aa55418f796f None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:45.868890 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4726c7-0a07-44c9-a027-aa55418f796f None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:45.873607 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeb37a-699c-4cd9-892e-822b14511b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:45.874281 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeb37a-699c-4cd9-892e-822b14511b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:45.874564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeb37a-699c-4cd9-892e-822b14511b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:45.874837 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeb37a-699c-4cd9-892e-822b14511b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:45.875522 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeb37a-699c-4cd9-892e-822b14511b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:45.877612 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeb37a-699c-4cd9-892e-822b14511b0e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:45.961474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1410/2810] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:57:45 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:45.962904 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:45.974034 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb0ae2-d319-4463-8eec-f1fb261539ed admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.033253 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe78037-57d6-43dc-84f1-2821113b439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.033928 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe78037-57d6-43dc-84f1-2821113b439b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.034227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe78037-57d6-43dc-84f1-2821113b439b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.034505 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe78037-57d6-43dc-84f1-2821113b439b admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.035315 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe78037-57d6-43dc-84f1-2821113b439b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.037231 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe78037-57d6-43dc-84f1-2821113b439b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.044377 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:46.138021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1401/2811] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:57:45 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:46.142571 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeb37a-699c-4cd9-892e-822b14511b0e admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.152866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeb37a-699c-4cd9-892e-822b14511b0e admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.157373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e87ecd-d4a1-48c4-ae2f-09987f0da0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.158681 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e87ecd-d4a1-48c4-ae2f-09987f0da0fe admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.158954 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e87ecd-d4a1-48c4-ae2f-09987f0da0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.159226 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e87ecd-d4a1-48c4-ae2f-09987f0da0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.159939 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e87ecd-d4a1-48c4-ae2f-09987f0da0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.161515 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e87ecd-d4a1-48c4-ae2f-09987f0da0fe admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.172013 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1411/2812] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:46.176125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe78037-57d6-43dc-84f1-2821113b439b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.187524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe78037-57d6-43dc-84f1-2821113b439b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.192639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74462db8-f302-486d-82b0-a686c1a0c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.193288 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74462db8-f302-486d-82b0-a686c1a0c0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.193570 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74462db8-f302-486d-82b0-a686c1a0c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.193848 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74462db8-f302-486d-82b0-a686c1a0c0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.194614 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74462db8-f302-486d-82b0-a686c1a0c0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.196193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74462db8-f302-486d-82b0-a686c1a0c0e1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.206892 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1402/2813] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:46.210949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e87ecd-d4a1-48c4-ae2f-09987f0da0fe admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.222256 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e87ecd-d4a1-48c4-ae2f-09987f0da0fe admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.227011 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bafbe-0b3b-44e3-b222-e86f81b35121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.227914 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bafbe-0b3b-44e3-b222-e86f81b35121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.228197 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bafbe-0b3b-44e3-b222-e86f81b35121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.228474 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bafbe-0b3b-44e3-b222-e86f81b35121 admin admin] PATH_INFO: `/v3/projects/b6aaae4d68a44d6b9fb5e003eb5a989b/users/11dc9eda05084f6b877750f9f509f363/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.243306 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bafbe-0b3b-44e3-b222-e86f81b35121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6aaae4d68a44d6b9fb5e003eb5a989b, user_id=11dc9eda05084f6b877750f9f509f363, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.245961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bafbe-0b3b-44e3-b222-e86f81b35121 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.334736 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1412/2814] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:46 2022] PUT /identity/v3/projects/b6aaae4d68a44d6b9fb5e003eb5a989b/users/11dc9eda05084f6b877750f9f509f363/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:46.344757 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1909-5cbb-4df6-8fa1-da733beb9965 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.345105 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1909-5cbb-4df6-8fa1-da733beb9965 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.346073 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1909-5cbb-4df6-8fa1-da733beb9965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.372242 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-108b1909-5cbb-4df6-8fa1-da733beb9965 None None] MFA Rules not processed for user `11dc9eda05084f6b877750f9f509f363`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:46.373465 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-108b1909-5cbb-4df6-8fa1-da733beb9965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:46.438481 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1403/2815] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:46.443196 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bafbe-0b3b-44e3-b222-e86f81b35121 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.508118 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bafbe-0b3b-44e3-b222-e86f81b35121 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.512997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeafbee-b52c-4276-b602-4f502f18d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.513646 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeafbee-b52c-4276-b602-4f502f18d591 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.513923 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeafbee-b52c-4276-b602-4f502f18d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.514332 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeafbee-b52c-4276-b602-4f502f18d591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.515041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeafbee-b52c-4276-b602-4f502f18d591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.517024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeafbee-b52c-4276-b602-4f502f18d591 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.581266 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1413/2816] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:57:46 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:46.585180 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b1909-5cbb-4df6-8fa1-da733beb9965 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.595754 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b1909-5cbb-4df6-8fa1-da733beb9965 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.651142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc548d1-8642-4001-a822-632cb6518e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.651807 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc548d1-8642-4001-a822-632cb6518e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.652091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc548d1-8642-4001-a822-632cb6518e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.652369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc548d1-8642-4001-a822-632cb6518e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.653049 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc548d1-8642-4001-a822-632cb6518e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.655088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc548d1-8642-4001-a822-632cb6518e38 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.739774 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1404/2817] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:57:46 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:46.743876 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeafbee-b52c-4276-b602-4f502f18d591 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.754910 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeafbee-b52c-4276-b602-4f502f18d591 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.759790 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab04b4-7a2c-4e5a-870b-1e9e1abb9ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.760395 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab04b4-7a2c-4e5a-870b-1e9e1abb9ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.760745 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab04b4-7a2c-4e5a-870b-1e9e1abb9ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.761053 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab04b4-7a2c-4e5a-870b-1e9e1abb9ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.761791 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab04b4-7a2c-4e5a-870b-1e9e1abb9ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.763458 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab04b4-7a2c-4e5a-870b-1e9e1abb9ba8 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.774706 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1414/2818] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 22:57:46.778668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc548d1-8642-4001-a822-632cb6518e38 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.788740 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc548d1-8642-4001-a822-632cb6518e38 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.793684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53d69-41c7-4353-82f1-3a73300147a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.794586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53d69-41c7-4353-82f1-3a73300147a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.794869 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53d69-41c7-4353-82f1-3a73300147a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.795142 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c53d69-41c7-4353-82f1-3a73300147a4 admin admin] PATH_INFO: `/v3/projects/bb3086d04e4c4f129e212b0211a66a97/users/583eda8e7da940b3935194e903addd56/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.809611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53d69-41c7-4353-82f1-3a73300147a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3086d04e4c4f129e212b0211a66a97, user_id=583eda8e7da940b3935194e903addd56, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.812265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c53d69-41c7-4353-82f1-3a73300147a4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.894361 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1405/2819] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:46 2022] PUT /identity/v3/projects/bb3086d04e4c4f129e212b0211a66a97/users/583eda8e7da940b3935194e903addd56/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:46.898241 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab04b4-7a2c-4e5a-870b-1e9e1abb9ba8 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.908422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab04b4-7a2c-4e5a-870b-1e9e1abb9ba8 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.917486 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:46.965393 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd18418-ed63-4293-8908-838a518752d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.966077 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd18418-ed63-4293-8908-838a518752d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.966382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd18418-ed63-4293-8908-838a518752d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.966656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd18418-ed63-4293-8908-838a518752d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:46.967373 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd18418-ed63-4293-8908-838a518752d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:46.968961 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd18418-ed63-4293-8908-838a518752d6 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:46.979858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1415/2820] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:46.982795 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53d69-41c7-4353-82f1-3a73300147a4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:46.993621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c53d69-41c7-4353-82f1-3a73300147a4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:46.998258 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:46.999123 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:46.999399 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:46.999667 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] PATH_INFO: `/v3/projects/bb3086d04e4c4f129e212b0211a66a97/users/583eda8e7da940b3935194e903addd56/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:47.002299 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3086d04e4c4f129e212b0211a66a97, user_id=583eda8e7da940b3935194e903addd56, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:47.004895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:47.015015 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1406/2821] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:46 2022] PUT /identity/v3/projects/bb3086d04e4c4f129e212b0211a66a97/users/583eda8e7da940b3935194e903addd56/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:57:47.024872 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a781-765e-448d-a44e-dd3f0bc0d3cf None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:47.025160 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a781-765e-448d-a44e-dd3f0bc0d3cf None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:47.025435 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3a781-765e-448d-a44e-dd3f0bc0d3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:47.052777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-7ce3a781-765e-448d-a44e-dd3f0bc0d3cf None None] MFA Rules not processed for user `583eda8e7da940b3935194e903addd56`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:47.054090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7ce3a781-765e-448d-a44e-dd3f0bc0d3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:47.123139 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1416/2822] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:47.135260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:47.136931 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:47.159779 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:47.196168 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4c927-50e8-4e07-9108-9ca995bc0210 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:47.199814 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81021d-b0b7-4a88-9eb0-7726af628c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:47.200443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81021d-b0b7-4a88-9eb0-7726af628c44 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:47.200723 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81021d-b0b7-4a88-9eb0-7726af628c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:47.200998 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81021d-b0b7-4a88-9eb0-7726af628c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:47.209921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81021d-b0b7-4a88-9eb0-7726af628c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:47.211354 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81021d-b0b7-4a88-9eb0-7726af628c44 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:47.220934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1407/2823] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:47.447091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a781-765e-448d-a44e-dd3f0bc0d3cf None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:47.456669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3a781-765e-448d-a44e-dd3f0bc0d3cf None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:47.460230 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60d15-7cb1-4fc3-b7fc-66b921651e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:47.460847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60d15-7cb1-4fc3-b7fc-66b921651e3c service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:47.461123 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60d15-7cb1-4fc3-b7fc-66b921651e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:47.461391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60d15-7cb1-4fc3-b7fc-66b921651e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:47.519318 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60d15-7cb1-4fc3-b7fc-66b921651e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:47.520792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60d15-7cb1-4fc3-b7fc-66b921651e3c service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:47.529809 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1417/2824] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:53.817605 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81021d-b0b7-4a88-9eb0-7726af628c44 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:53.879914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81021d-b0b7-4a88-9eb0-7726af628c44 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:53.884464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:53.885330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:53.885611 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:53.885934 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] PATH_INFO: `/v3/users/11dc9eda05084f6b877750f9f509f363` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:53.887206 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dc9eda05084f6b877750f9f509f363)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:53.889117 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:54.073406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dc9eda05084f6b877750f9f509f363'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.150647 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dc9eda05084f6b877750f9f509f363'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.158509 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dc9eda05084f6b877750f9f509f363'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.159147 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dc9eda05084f6b877750f9f509f363'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.171275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dc9eda05084f6b877750f9f509f363'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.177133 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1408/2825] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:57:53 2022] DELETE /identity/v3/users/11dc9eda05084f6b877750f9f509f363 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:54.181573 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83673-8130-44cb-b84a-69e9498f750b None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:54.182098 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83673-8130-44cb-b84a-69e9498f750b None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:54.182257 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f83673-8130-44cb-b84a-69e9498f750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:54.200189 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-80f83673-8130-44cb-b84a-69e9498f750b None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:54.201375 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-80f83673-8130-44cb-b84a-69e9498f750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:54.230677 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:54.261579 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1418/2826] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:54.272032 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:54.273419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:54.318775 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:54.330543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cb5dc-1cf0-4438-b3df-827064cb5c2d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:54.334182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565682ec-494f-4121-803f-37f671f648fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:54.334820 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565682ec-494f-4121-803f-37f671f648fd service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:54.335096 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565682ec-494f-4121-803f-37f671f648fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:54.335367 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565682ec-494f-4121-803f-37f671f648fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:54.344440 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565682ec-494f-4121-803f-37f671f648fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:54.346092 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565682ec-494f-4121-803f-37f671f648fd service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:54.356282 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1409/2827] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 22:57:54.752229 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f83673-8130-44cb-b84a-69e9498f750b None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:54.753746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-80f83673-8130-44cb-b84a-69e9498f750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:54.766106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f83673-8130-44cb-b84a-69e9498f750b None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:54.770874 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:54.774156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:54.774156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:54.774156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] PATH_INFO: `/v3/projects/b6aaae4d68a44d6b9fb5e003eb5a989b` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:54.774156 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6aaae4d68a44d6b9fb5e003eb5a989b)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:54.775372 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:54.858843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6aaae4d68a44d6b9fb5e003eb5a989b', 'request_id': 'req-52b9645f-6cee-472c-865e-6cfba368afff'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.904374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6aaae4d68a44d6b9fb5e003eb5a989b', 'request_id': 'req-52b9645f-6cee-472c-865e-6cfba368afff'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.910448 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6aaae4d68a44d6b9fb5e003eb5a989b', 'request_id': 'req-52b9645f-6cee-472c-865e-6cfba368afff'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.921649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] The token cache is being invalidate because project b6aaae4d68a44d6b9fb5e003eb5a989b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:57:54.921912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.922559 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:54.924629 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1419/2828] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:57:54 2022] DELETE /identity/v3/projects/b6aaae4d68a44d6b9fb5e003eb5a989b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:54.930265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565682ec-494f-4121-803f-37f671f648fd service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:54.940586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565682ec-494f-4121-803f-37f671f648fd service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:54.998317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:54.999182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:54.999463 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:54.999736 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] PATH_INFO: `/v3/users/583eda8e7da940b3935194e903addd56` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:55.000921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=583eda8e7da940b3935194e903addd56)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:55.002918 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:55.175912 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '583eda8e7da940b3935194e903addd56'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.253275 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '583eda8e7da940b3935194e903addd56'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.260575 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '583eda8e7da940b3935194e903addd56'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.261191 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '583eda8e7da940b3935194e903addd56'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.273546 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-bb5d8e97-fb62-4d39-a7ed-7b85e755bd1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '583eda8e7da940b3935194e903addd56'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.279398 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1410/2829] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:57:54 2022] DELETE /identity/v3/users/583eda8e7da940b3935194e903addd56 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:55.659656 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:55.661187 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:55.675519 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9645f-6cee-472c-865e-6cfba368afff admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:55.733694 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:55.734572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:55.734848 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:55.735116 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] PATH_INFO: `/v3/projects/bb3086d04e4c4f129e212b0211a66a97` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:55.736293 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3086d04e4c4f129e212b0211a66a97)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:55.738333 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:55.847205 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3086d04e4c4f129e212b0211a66a97', 'request_id': 'req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.944643 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3086d04e4c4f129e212b0211a66a97', 'request_id': 'req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.946792 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:55.950882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3086d04e4c4f129e212b0211a66a97', 'request_id': 'req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.962112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] The token cache is being invalidate because project bb3086d04e4c4f129e212b0211a66a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:57:55.962398 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.963041 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-d15de9e3-5e3a-4b60-8f93-6fd6371eddb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:55.964572 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1420/2830] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:57:55 2022] DELETE /identity/v3/projects/bb3086d04e4c4f129e212b0211a66a97 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:55.969410 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc7d7-c0c5-4d35-b0f8-4bb123244158 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:55.969878 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc7d7-c0c5-4d35-b0f8-4bb123244158 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:55.970082 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc7d7-c0c5-4d35-b0f8-4bb123244158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:55.988365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1b8dc7d7-c0c5-4d35-b0f8-4bb123244158 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:55.989591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1b8dc7d7-c0c5-4d35-b0f8-4bb123244158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:56.050083 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1411/2831] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:56.057532 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aff62-e50a-4ec7-9d0f-0b1bcef47994 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.057823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aff62-e50a-4ec7-9d0f-0b1bcef47994 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.058137 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aff62-e50a-4ec7-9d0f-0b1bcef47994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.077714 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-9b1aff62-e50a-4ec7-9d0f-0b1bcef47994 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:56.078960 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-9b1aff62-e50a-4ec7-9d0f-0b1bcef47994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:56.087286 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1421/2832] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:56.091527 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc7d7-c0c5-4d35-b0f8-4bb123244158 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:56.097618 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:56.101470 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc7d7-c0c5-4d35-b0f8-4bb123244158 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:56.106019 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:56.111495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.111495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.111495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.111495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:57:56.111495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:56.111495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:56.122858 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1412/2833] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:57:56.127626 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aff62-e50a-4ec7-9d0f-0b1bcef47994 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:56.136847 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aff62-e50a-4ec7-9d0f-0b1bcef47994 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:56.141741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac468ce-b74c-48c4-907b-927731667f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:56.142684 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac468ce-b74c-48c4-907b-927731667f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.142964 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac468ce-b74c-48c4-907b-927731667f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.143238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac468ce-b74c-48c4-907b-927731667f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.143937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac468ce-b74c-48c4-907b-927731667f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:56.145824 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac468ce-b74c-48c4-907b-927731667f82 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:56.224669 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1422/2834] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:57:56 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:57:56.225801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:56.236639 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41883403-349d-4d26-b28d-2ac58357bbf4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:56.295203 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0b7e7-1cab-4a1e-b6ec-e792038fe6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:56.295866 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b7e7-1cab-4a1e-b6ec-e792038fe6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.296149 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b7e7-1cab-4a1e-b6ec-e792038fe6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.296423 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0b7e7-1cab-4a1e-b6ec-e792038fe6ae admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.297112 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0b7e7-1cab-4a1e-b6ec-e792038fe6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:56.299947 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0b7e7-1cab-4a1e-b6ec-e792038fe6ae admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:56.390409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1413/2835] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:57:56 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:57:56.394845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac468ce-b74c-48c4-907b-927731667f82 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:56.405023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac468ce-b74c-48c4-907b-927731667f82 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:56.410206 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e008d-900f-4488-b55d-753876bfa076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:56.410849 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e008d-900f-4488-b55d-753876bfa076 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.411125 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e008d-900f-4488-b55d-753876bfa076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.411396 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e008d-900f-4488-b55d-753876bfa076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.412114 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e008d-900f-4488-b55d-753876bfa076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:56.413705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e008d-900f-4488-b55d-753876bfa076 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:56.424780 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1423/2836] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:56.428695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0b7e7-1cab-4a1e-b6ec-e792038fe6ae admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:56.438508 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0b7e7-1cab-4a1e-b6ec-e792038fe6ae admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:56.443260 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917fb78-e601-4338-b650-e9ff2b6dffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:56.443898 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fb78-e601-4338-b650-e9ff2b6dffa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.444176 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fb78-e601-4338-b650-e9ff2b6dffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.444447 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fb78-e601-4338-b650-e9ff2b6dffa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.445158 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917fb78-e601-4338-b650-e9ff2b6dffa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:56.446805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917fb78-e601-4338-b650-e9ff2b6dffa0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:56.456629 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1414/2837] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:56.460823 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e008d-900f-4488-b55d-753876bfa076 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:56.471549 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e008d-900f-4488-b55d-753876bfa076 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:56.476175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1988a2-d289-4d2a-9f3a-c5a14e160951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:56.482644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1988a2-d289-4d2a-9f3a-c5a14e160951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.482644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1988a2-d289-4d2a-9f3a-c5a14e160951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.482644 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1988a2-d289-4d2a-9f3a-c5a14e160951 admin admin] PATH_INFO: `/v3/projects/7ced3ed665864994be4e9b8c18f16070/users/dd880c2cb34e406c9b68de76527c691d/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.492894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1988a2-d289-4d2a-9f3a-c5a14e160951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ced3ed665864994be4e9b8c18f16070, user_id=dd880c2cb34e406c9b68de76527c691d, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:56.495703 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1988a2-d289-4d2a-9f3a-c5a14e160951 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:56.561708 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1424/2838] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:56 2022] PUT /identity/v3/projects/7ced3ed665864994be4e9b8c18f16070/users/dd880c2cb34e406c9b68de76527c691d/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:56.572120 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb6c29-1a8d-4848-b4be-84738d1dfe4d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.572344 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb6c29-1a8d-4848-b4be-84738d1dfe4d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.572617 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb6c29-1a8d-4848-b4be-84738d1dfe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.599156 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9deb6c29-1a8d-4848-b4be-84738d1dfe4d None None] MFA Rules not processed for user `dd880c2cb34e406c9b68de76527c691d`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:56.600342 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9deb6c29-1a8d-4848-b4be-84738d1dfe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:56.663144 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1415/2839] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:56.667814 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1988a2-d289-4d2a-9f3a-c5a14e160951 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:56.730076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1988a2-d289-4d2a-9f3a-c5a14e160951 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:56.734746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd180b-3463-410d-9cc4-ab56c26cb859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:56.735389 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd180b-3463-410d-9cc4-ab56c26cb859 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.735882 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd180b-3463-410d-9cc4-ab56c26cb859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.736201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd180b-3463-410d-9cc4-ab56c26cb859 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.736845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd180b-3463-410d-9cc4-ab56c26cb859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:56.738772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd180b-3463-410d-9cc4-ab56c26cb859 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:56.825706 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1425/2840] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:57:56 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:57:56.830507 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb6c29-1a8d-4848-b4be-84738d1dfe4d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:56.840914 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb6c29-1a8d-4848-b4be-84738d1dfe4d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:56.896152 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd1685-3839-4b76-92dd-558e8422e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:56.896802 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1685-3839-4b76-92dd-558e8422e455 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:56.897080 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1685-3839-4b76-92dd-558e8422e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:56.897334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1685-3839-4b76-92dd-558e8422e455 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:56.898036 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd1685-3839-4b76-92dd-558e8422e455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:56.899920 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd1685-3839-4b76-92dd-558e8422e455 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:56.906418 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:56.985368 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1416/2841] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:57:56 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:57:56.989548 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd180b-3463-410d-9cc4-ab56c26cb859 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:57.000012 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd180b-3463-410d-9cc4-ab56c26cb859 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:57.005547 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bdc11-e606-4d29-89b8-61ab5fc7d9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:57.006304 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bdc11-e606-4d29-89b8-61ab5fc7d9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:57.010723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bdc11-e606-4d29-89b8-61ab5fc7d9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:57.010723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bdc11-e606-4d29-89b8-61ab5fc7d9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:57.010723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bdc11-e606-4d29-89b8-61ab5fc7d9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:57.010723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bdc11-e606-4d29-89b8-61ab5fc7d9b7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:57.020413 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1426/2842] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:57.024495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd1685-3839-4b76-92dd-558e8422e455 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:57.034633 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd1685-3839-4b76-92dd-558e8422e455 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:57.039396 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16985772-88c1-461f-8526-5cb9ed9ea769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:57.040741 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985772-88c1-461f-8526-5cb9ed9ea769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:57.041020 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985772-88c1-461f-8526-5cb9ed9ea769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:57.041289 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16985772-88c1-461f-8526-5cb9ed9ea769 admin admin] PATH_INFO: `/v3/projects/d8dc467201f9444a8ef57a45826096f9/users/048e9250df7f433b96ec2e788be31466/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:57.056334 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16985772-88c1-461f-8526-5cb9ed9ea769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dc467201f9444a8ef57a45826096f9, user_id=048e9250df7f433b96ec2e788be31466, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:57.058997 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16985772-88c1-461f-8526-5cb9ed9ea769 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:57.149864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1417/2843] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:57 2022] PUT /identity/v3/projects/d8dc467201f9444a8ef57a45826096f9/users/048e9250df7f433b96ec2e788be31466/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:57.153887 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bdc11-e606-4d29-89b8-61ab5fc7d9b7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:57.164085 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bdc11-e606-4d29-89b8-61ab5fc7d9b7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:57.213416 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:57.219049 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e85c6-3a76-4cc5-8f3b-5bd9e5c0c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:57.219723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e85c6-3a76-4cc5-8f3b-5bd9e5c0c22b admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:57.220044 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e85c6-3a76-4cc5-8f3b-5bd9e5c0c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:57.220316 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e85c6-3a76-4cc5-8f3b-5bd9e5c0c22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:57.221024 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e85c6-3a76-4cc5-8f3b-5bd9e5c0c22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:57.222649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e85c6-3a76-4cc5-8f3b-5bd9e5c0c22b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:57.232423 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1427/2844] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:57:57.236732 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16985772-88c1-461f-8526-5cb9ed9ea769 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:57.246968 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16985772-88c1-461f-8526-5cb9ed9ea769 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:57.252150 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:57.258946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:57.258946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:57.258946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] PATH_INFO: `/v3/projects/d8dc467201f9444a8ef57a45826096f9/users/048e9250df7f433b96ec2e788be31466/roles/fe643140d2134736a54afd972d47d43f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:57.258946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dc467201f9444a8ef57a45826096f9, user_id=048e9250df7f433b96ec2e788be31466, role_id=fe643140d2134736a54afd972d47d43f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:57.258946 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:57.269811 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1418/2845] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:57:57 2022] PUT /identity/v3/projects/d8dc467201f9444a8ef57a45826096f9/users/048e9250df7f433b96ec2e788be31466/roles/fe643140d2134736a54afd972d47d43f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:57:57.280702 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019e24-fbc7-41a8-8651-a474f753f6d5 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:57.280986 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019e24-fbc7-41a8-8651-a474f753f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:57.281359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b019e24-fbc7-41a8-8651-a474f753f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:57.308052 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-0b019e24-fbc7-41a8-8651-a474f753f6d5 None None] MFA Rules not processed for user `048e9250df7f433b96ec2e788be31466`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:57.309250 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0b019e24-fbc7-41a8-8651-a474f753f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:57.377149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1428/2846] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:57.388330 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:57.390033 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:57.446794 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892391-b0f7-4beb-994a-62c277f05fd3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:57.450642 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97a4e1-baa7-4ee9-8d38-ed654e475172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:57.451412 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a4e1-baa7-4ee9-8d38-ed654e475172 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:57.451699 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a4e1-baa7-4ee9-8d38-ed654e475172 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:57.451973 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97a4e1-baa7-4ee9-8d38-ed654e475172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:57.461513 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97a4e1-baa7-4ee9-8d38-ed654e475172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:57.462967 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97a4e1-baa7-4ee9-8d38-ed654e475172 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:57.472472 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1419/2847] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:58.646112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019e24-fbc7-41a8-8651-a474f753f6d5 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:58.647592 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-0b019e24-fbc7-41a8-8651-a474f753f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:58.673559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97a4e1-baa7-4ee9-8d38-ed654e475172 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:58.706883 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b019e24-fbc7-41a8-8651-a474f753f6d5 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:58.710911 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b9aa9-49f8-4b91-8760-e89757f8c980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:58.712238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b9aa9-49f8-4b91-8760-e89757f8c980 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:58.712238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b9aa9-49f8-4b91-8760-e89757f8c980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:58.712238 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b9aa9-49f8-4b91-8760-e89757f8c980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:58.713858 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-586b9aa9-49f8-4b91-8760-e89757f8c980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:58.739408 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97a4e1-baa7-4ee9-8d38-ed654e475172 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:58.743951 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:58.744808 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:58.745094 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:58.745365 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] PATH_INFO: `/v3/users/dd880c2cb34e406c9b68de76527c691d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:58.746568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd880c2cb34e406c9b68de76527c691d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:58.748471 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:58.781995 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b9aa9-49f8-4b91-8760-e89757f8c980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:58.787355 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b9aa9-49f8-4b91-8760-e89757f8c980 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:58.793312 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1429/2848] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:58.964621 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd880c2cb34e406c9b68de76527c691d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.035042 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd880c2cb34e406c9b68de76527c691d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.041654 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=6,keystone:SELECT=86,keystone:DELETE=8 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:59.044362 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd880c2cb34e406c9b68de76527c691d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.045059 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd880c2cb34e406c9b68de76527c691d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.057925 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd880c2cb34e406c9b68de76527c691d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.064879 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1420/2849] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:57:58 2022] DELETE /identity/v3/users/dd880c2cb34e406c9b68de76527c691d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 22:57:59.069639 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ea99f-8d0f-4718-9fbd-97ce87e787b3 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:59.070055 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ea99f-8d0f-4718-9fbd-97ce87e787b3 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:59.070339 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ea99f-8d0f-4718-9fbd-97ce87e787b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:59.087642 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-5f2ea99f-8d0f-4718-9fbd-97ce87e787b3 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:57:59.094627 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5f2ea99f-8d0f-4718-9fbd-97ce87e787b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:59.113901 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=100 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:59.148709 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1430/2850] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:57:59.158921 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:59.160352 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:59.218043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68572f8d-5cc4-42fe-9f2c-38cf70a951fc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:59.222430 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d671c-8ea3-49fb-9206-8d80e6122506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:59.226179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d671c-8ea3-49fb-9206-8d80e6122506 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:59.226179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d671c-8ea3-49fb-9206-8d80e6122506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:59.226179 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d671c-8ea3-49fb-9206-8d80e6122506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:59.232985 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d671c-8ea3-49fb-9206-8d80e6122506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:59.234454 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d671c-8ea3-49fb-9206-8d80e6122506 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:59.244485 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1421/2851] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:57:59.677400 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ea99f-8d0f-4718-9fbd-97ce87e787b3 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:59.678934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-5f2ea99f-8d0f-4718-9fbd-97ce87e787b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:57:59.692977 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ea99f-8d0f-4718-9fbd-97ce87e787b3 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:57:59.698460 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:57:59.699338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:57:59.699617 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:57:59.699891 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] PATH_INFO: `/v3/projects/7ced3ed665864994be4e9b8c18f16070` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:57:59.701095 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ced3ed665864994be4e9b8c18f16070)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:57:59.703063 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:57:59.853651 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ced3ed665864994be4e9b8c18f16070', 'request_id': 'req-8173725f-a693-4b6b-b307-07217994dc57'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.926801 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ced3ed665864994be4e9b8c18f16070', 'request_id': 'req-8173725f-a693-4b6b-b307-07217994dc57'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.933108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ced3ed665864994be4e9b8c18f16070', 'request_id': 'req-8173725f-a693-4b6b-b307-07217994dc57'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.946207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] The token cache is being invalidate because project 7ced3ed665864994be4e9b8c18f16070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:57:59.946537 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.947149 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:57:59.948967 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1431/2852] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:57:59 2022] DELETE /identity/v3/projects/7ced3ed665864994be4e9b8c18f16070 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:57:59.952668 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d671c-8ea3-49fb-9206-8d80e6122506 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:57:59.962603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d671c-8ea3-49fb-9206-8d80e6122506 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:00.020876 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:00.021661 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:00.021940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:00.022290 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] PATH_INFO: `/v3/users/048e9250df7f433b96ec2e788be31466` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:00.023451 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048e9250df7f433b96ec2e788be31466)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:00.025382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:00.254543 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048e9250df7f433b96ec2e788be31466'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:00.326284 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048e9250df7f433b96ec2e788be31466'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:00.334603 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048e9250df7f433b96ec2e788be31466'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:00.336331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048e9250df7f433b96ec2e788be31466'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:00.347461 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:00.348843 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fe8a1fd0-380f-4b00-ae2d-aed62877f5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048e9250df7f433b96ec2e788be31466'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:00.355419 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1422/2853] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:57:59 2022] DELETE /identity/v3/users/048e9250df7f433b96ec2e788be31466 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:58:00.769391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:00.770749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:00.790746 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173725f-a693-4b6b-b307-07217994dc57 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:00.853259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:00.854194 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:00.854469 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:00.854753 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] PATH_INFO: `/v3/projects/d8dc467201f9444a8ef57a45826096f9` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:00.856140 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8dc467201f9444a8ef57a45826096f9)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:00.858337 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:00.974714 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8dc467201f9444a8ef57a45826096f9', 'request_id': 'req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:00.978314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:01.052811 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8dc467201f9444a8ef57a45826096f9', 'request_id': 'req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:01.060026 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8dc467201f9444a8ef57a45826096f9', 'request_id': 'req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:01.076076 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] The token cache is being invalidate because project d8dc467201f9444a8ef57a45826096f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:58:01.076465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:01.077243 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-b846fd8d-a2b1-4b4a-b60e-1003f0a9086e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:58:01.079661 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1432/2854] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:58:00 2022] DELETE /identity/v3/projects/d8dc467201f9444a8ef57a45826096f9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:58:01.084534 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9be24-f73d-4ad1-89c9-26303c1918e1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.096108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9be24-f73d-4ad1-89c9-26303c1918e1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.096108 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9be24-f73d-4ad1-89c9-26303c1918e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.108805 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-83b9be24-f73d-4ad1-89c9-26303c1918e1 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:58:01.110220 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-83b9be24-f73d-4ad1-89c9-26303c1918e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:01.177227 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1423/2855] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 22:58:01.186994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb11b-2ea3-4ca2-bce6-559fe8bf8a2a None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.188845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb11b-2ea3-4ca2-bce6-559fe8bf8a2a None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.188845 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb11b-2ea3-4ca2-bce6-559fe8bf8a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.209245 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-ce4bb11b-2ea3-4ca2-bce6-559fe8bf8a2a None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:58:01.210605 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ce4bb11b-2ea3-4ca2-bce6-559fe8bf8a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:01.219613 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1433/2856] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:58:01.225359 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9be24-f73d-4ad1-89c9-26303c1918e1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:01.236959 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9be24-f73d-4ad1-89c9-26303c1918e1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:01.241804 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:01.242653 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.253902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.253902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.253902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:58:01.253902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:01.253902 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:01.262444 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1424/2857] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:58:01.263831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb11b-2ea3-4ca2-bce6-559fe8bf8a2a None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:01.275574 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb11b-2ea3-4ca2-bce6-559fe8bf8a2a None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:01.280638 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c501462-3048-4cc1-812e-d45b5faf4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:01.281342 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c501462-3048-4cc1-812e-d45b5faf4729 admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.281624 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c501462-3048-4cc1-812e-d45b5faf4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.281895 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c501462-3048-4cc1-812e-d45b5faf4729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.282723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c501462-3048-4cc1-812e-d45b5faf4729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:01.284949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c501462-3048-4cc1-812e-d45b5faf4729 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:01.387445 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1434/2858] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:58:01 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:58:01.389582 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:01.406369 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d75215-cf64-424f-8b5d-7ac39bb528e4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:01.481538 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8aaa-880f-47f6-b5d9-d874d0905a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:01.482257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8aaa-880f-47f6-b5d9-d874d0905a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.482586 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8aaa-880f-47f6-b5d9-d874d0905a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.482861 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8aaa-880f-47f6-b5d9-d874d0905a94 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.483579 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c8aaa-880f-47f6-b5d9-d874d0905a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:01.486720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c8aaa-880f-47f6-b5d9-d874d0905a94 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:01.607277 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1425/2859] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:58:01 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 22:58:01.609064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c501462-3048-4cc1-812e-d45b5faf4729 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:01.620749 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c501462-3048-4cc1-812e-d45b5faf4729 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:01.626096 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85f75a-7c63-4a02-aa7b-7aca74953f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:01.626943 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85f75a-7c63-4a02-aa7b-7aca74953f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.627465 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85f75a-7c63-4a02-aa7b-7aca74953f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.627831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85f75a-7c63-4a02-aa7b-7aca74953f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.628698 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85f75a-7c63-4a02-aa7b-7aca74953f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:01.630426 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85f75a-7c63-4a02-aa7b-7aca74953f50 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:01.641948 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1435/2860] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:58:01.649061 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8aaa-880f-47f6-b5d9-d874d0905a94 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:01.660214 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8aaa-880f-47f6-b5d9-d874d0905a94 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:01.665533 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa50fa5-f750-4ef0-ac55-dae5d1929bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:01.666887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa50fa5-f750-4ef0-ac55-dae5d1929bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.666887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa50fa5-f750-4ef0-ac55-dae5d1929bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.666887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa50fa5-f750-4ef0-ac55-dae5d1929bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.667778 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa50fa5-f750-4ef0-ac55-dae5d1929bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:01.669443 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa50fa5-f750-4ef0-ac55-dae5d1929bb1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:01.687497 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1426/2861] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:58:01.688695 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85f75a-7c63-4a02-aa7b-7aca74953f50 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:01.700868 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85f75a-7c63-4a02-aa7b-7aca74953f50 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:01.707933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:01.709294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.709294 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.712665 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] PATH_INFO: `/v3/projects/5b2b243ed5194c57a9513438ed308d2f/users/1cbd496c75b84fffa96cbbf929fc5f5a/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.725908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2b243ed5194c57a9513438ed308d2f, user_id=1cbd496c75b84fffa96cbbf929fc5f5a, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:01.728742 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:01.797169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1436/2862] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:58:01 2022] PUT /identity/v3/projects/5b2b243ed5194c57a9513438ed308d2f/users/1cbd496c75b84fffa96cbbf929fc5f5a/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:58:01.802895 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42890ff-922e-475f-94ce-78d8d06900d2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.803186 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42890ff-922e-475f-94ce-78d8d06900d2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.803464 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42890ff-922e-475f-94ce-78d8d06900d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.823703 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d42890ff-922e-475f-94ce-78d8d06900d2 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:58:01.824916 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d42890ff-922e-475f-94ce-78d8d06900d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:01.885052 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1427/2863] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:58:01.895987 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:01.898105 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:01.969989 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21911b-0f23-4480-a917-308b13ce717c admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:01.974258 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:01.977239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:01.977239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:01.977239 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:01.984881 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:01.986926 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:01.996179 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1437/2864] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:58:03.403089 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8141-f358-4123-85ee-c962f09c3713 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:03.403593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8141-f358-4123-85ee-c962f09c3713 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:03.403702 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b8141-f358-4123-85ee-c962f09c3713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:03.411391 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:03.434107 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-999b8141-f358-4123-85ee-c962f09c3713 None None] MFA Rules not processed for user `1cbd496c75b84fffa96cbbf929fc5f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:58:03.435317 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-999b8141-f358-4123-85ee-c962f09c3713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:03.501675 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1428/2865] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:58:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:58:03.512387 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:03.513777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:03.576225 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddd5ae-f90b-4ed3-8ecc-479d2d518968 service neutron] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:03.581008 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99a218-239e-4e3f-bd2a-40a4ea88a95d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:03.581714 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a218-239e-4e3f-bd2a-40a4ea88a95d service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:03.581997 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a218-239e-4e3f-bd2a-40a4ea88a95d service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:03.582338 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99a218-239e-4e3f-bd2a-40a4ea88a95d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:03.591359 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a218-239e-4e3f-bd2a-40a4ea88a95d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:03.592908 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99a218-239e-4e3f-bd2a-40a4ea88a95d service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:03.602112 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1438/2866] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:58:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:58:06.397851 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af571f-74a0-46da-86a2-2569b1517eb6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:06.398476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af571f-74a0-46da-86a2-2569b1517eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:06.398476 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af571f-74a0-46da-86a2-2569b1517eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:06.416090 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-18af571f-74a0-46da-86a2-2569b1517eb6 None None] MFA Rules not processed for user `1cbd496c75b84fffa96cbbf929fc5f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:58:06.417265 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-18af571f-74a0-46da-86a2-2569b1517eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:06.424676 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1429/2867] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:58:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:58:13.597933 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=85,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:16.410594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=34 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:23.546553 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766f34-69ba-41d1-b74f-92a6aafe0798 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:23.547064 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766f34-69ba-41d1-b74f-92a6aafe0798 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:23.547220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766f34-69ba-41d1-b74f-92a6aafe0798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:23.564621 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-b9766f34-69ba-41d1-b74f-92a6aafe0798 None None] MFA Rules not processed for user `1cbd496c75b84fffa96cbbf929fc5f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:58:23.566379 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b9766f34-69ba-41d1-b74f-92a6aafe0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:23.573126 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1439/2868] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:58:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:58:33.559142 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:48.436547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259d0d3-5660-4e17-9063-7536856c5312 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:48.437132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259d0d3-5660-4e17-9063-7536856c5312 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:48.437132 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259d0d3-5660-4e17-9063-7536856c5312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:48.454648 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2259d0d3-5660-4e17-9063-7536856c5312 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:58:48.455822 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2259d0d3-5660-4e17-9063-7536856c5312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:48.512625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1430/2869] 10.222.0.70 () {58 vars in 1009 bytes} [Wed May 18 22:58:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:58:48.552545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9766f34-69ba-41d1-b74f-92a6aafe0798 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:58:48.554772 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-b9766f34-69ba-41d1-b74f-92a6aafe0798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:58:48.621955 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9766f34-69ba-41d1-b74f-92a6aafe0798 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:58:48.626799 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d597f-f676-49ff-9491-9cf00679968d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:58:48.627427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d597f-f676-49ff-9491-9cf00679968d service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:58:48.627704 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d597f-f676-49ff-9491-9cf00679968d service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:58:48.627973 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d597f-f676-49ff-9491-9cf00679968d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:58:48.636499 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d597f-f676-49ff-9491-9cf00679968d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:58:48.638086 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d597f-f676-49ff-9491-9cf00679968d service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:58:48.645820 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1440/2870] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:58:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:58:58.505069 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=25 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:58.642741 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=32 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:04.739331 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86e1a-150e-45fa-9e9c-daeb1f4467f4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:04.739826 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86e1a-150e-45fa-9e9c-daeb1f4467f4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:04.740436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e86e1a-150e-45fa-9e9c-daeb1f4467f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:04.758436 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c4e86e1a-150e-45fa-9e9c-daeb1f4467f4 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:59:04.759625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c4e86e1a-150e-45fa-9e9c-daeb1f4467f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:59:04.766745 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1431/2871] 10.222.0.70 () {58 vars in 967 bytes} [Wed May 18 22:59:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:59:04.778563 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d597f-f676-49ff-9491-9cf00679968d service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:04.789130 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d597f-f676-49ff-9491-9cf00679968d service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:04.794526 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22949e9-4f5f-48df-8b12-95c9b2efcb0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:04.795146 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22949e9-4f5f-48df-8b12-95c9b2efcb0b service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:04.795422 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22949e9-4f5f-48df-8b12-95c9b2efcb0b service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:04.795690 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22949e9-4f5f-48df-8b12-95c9b2efcb0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:04.804161 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22949e9-4f5f-48df-8b12-95c9b2efcb0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:04.805705 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22949e9-4f5f-48df-8b12-95c9b2efcb0b service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:04.813764 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1441/2872] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 22:59:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 22:59:07.744801 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86e1a-150e-45fa-9e9c-daeb1f4467f4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:07.756828 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e86e1a-150e-45fa-9e9c-daeb1f4467f4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:07.761455 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:07.762438 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:07.762623 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:07.762894 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] PATH_INFO: `/v3/users/1cbd496c75b84fffa96cbbf929fc5f5a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:07.764088 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cbd496c75b84fffa96cbbf929fc5f5a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:07.765970 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:07.956593 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cbd496c75b84fffa96cbbf929fc5f5a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.047014 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cbd496c75b84fffa96cbbf929fc5f5a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.054876 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cbd496c75b84fffa96cbbf929fc5f5a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.055664 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cbd496c75b84fffa96cbbf929fc5f5a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.068146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3fcb193c-9ffc-4385-ae24-4640d553a80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cbd496c75b84fffa96cbbf929fc5f5a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.074193 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1432/2873] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:59:07 2022] DELETE /identity/v3/users/1cbd496c75b84fffa96cbbf929fc5f5a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:59:08.337762 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22949e9-4f5f-48df-8b12-95c9b2efcb0b service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:08.352582 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22949e9-4f5f-48df-8b12-95c9b2efcb0b service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:08.415223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:08.416106 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:08.416388 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:08.416664 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] PATH_INFO: `/v3/projects/5b2b243ed5194c57a9513438ed308d2f` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:08.418134 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2b243ed5194c57a9513438ed308d2f)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:08.420701 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:08.568365 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2b243ed5194c57a9513438ed308d2f', 'request_id': 'req-09b85b25-b5a7-4756-b027-2014aa8889d3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.646473 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2b243ed5194c57a9513438ed308d2f', 'request_id': 'req-09b85b25-b5a7-4756-b027-2014aa8889d3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.653259 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2b243ed5194c57a9513438ed308d2f', 'request_id': 'req-09b85b25-b5a7-4756-b027-2014aa8889d3'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.665443 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] The token cache is being invalidate because project 5b2b243ed5194c57a9513438ed308d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:59:08.665732 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.666409 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-09b85b25-b5a7-4756-b027-2014aa8889d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:08.668217 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1442/2874] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:59:08 2022] DELETE /identity/v3/projects/5b2b243ed5194c57a9513438ed308d2f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:59:08.673790 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2ff23-281f-4293-9a05-28405fa01822 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:08.674095 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2ff23-281f-4293-9a05-28405fa01822 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:08.674375 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2ff23-281f-4293-9a05-28405fa01822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:08.693671 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-18f2ff23-281f-4293-9a05-28405fa01822 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:59:08.695504 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-18f2ff23-281f-4293-9a05-28405fa01822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:59:08.763883 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1433/2875] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:59:08.771878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1c52-0447-4c60-a356-1f9d150c558c None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:08.772169 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1c52-0447-4c60-a356-1f9d150c558c None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:08.772520 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1c52-0447-4c60-a356-1f9d150c558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:08.792991 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-297a1c52-0447-4c60-a356-1f9d150c558c None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:59:08.794253 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-297a1c52-0447-4c60-a356-1f9d150c558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:59:08.803050 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1443/2876] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:59:08.808091 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2ff23-281f-4293-9a05-28405fa01822 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:08.817781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2ff23-281f-4293-9a05-28405fa01822 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:08.823473 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:08.824111 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:08.824388 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:08.824663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:08.825390 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 22:59:08.825705 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:08.827535 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:08.840409 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1434/2877] 10.222.0.70 () {58 vars in 1152 bytes} [Wed May 18 22:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 22:59:08.847209 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1c52-0447-4c60-a356-1f9d150c558c None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:08.859831 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1c52-0447-4c60-a356-1f9d150c558c None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:08.865108 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e5d3-54d9-4e70-bb54-b40ca67a7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:08.865777 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e5d3-54d9-4e70-bb54-b40ca67a7d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:08.866700 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e5d3-54d9-4e70-bb54-b40ca67a7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:08.866994 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e5d3-54d9-4e70-bb54-b40ca67a7d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:08.867660 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083e5d3-54d9-4e70-bb54-b40ca67a7d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:08.870894 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083e5d3-54d9-4e70-bb54-b40ca67a7d2b admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:08.973471 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1444/2878] 10.222.0.70 () {60 vars in 1152 bytes} [Wed May 18 22:59:08 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:59:08.974758 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:08.986311 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107555b-4b39-478b-9956-fba0dc3663c9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:09.036201 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:09.046028 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8923b-fec3-49ad-ac0b-64dd065a311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:09.051392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8923b-fec3-49ad-ac0b-64dd065a311d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:09.051392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8923b-fec3-49ad-ac0b-64dd065a311d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:09.051392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8923b-fec3-49ad-ac0b-64dd065a311d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:09.051392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8923b-fec3-49ad-ac0b-64dd065a311d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:09.051392 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8923b-fec3-49ad-ac0b-64dd065a311d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:09.159781 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1435/2879] 10.222.0.70 () {60 vars in 1143 bytes} [Wed May 18 22:59:08 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 22:59:09.164223 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e5d3-54d9-4e70-bb54-b40ca67a7d2b admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:09.174857 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e5d3-54d9-4e70-bb54-b40ca67a7d2b admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:09.180023 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf670-9964-4731-bcc2-b0882f10299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:09.180758 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf670-9964-4731-bcc2-b0882f10299a admin admin] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:09.181001 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf670-9964-4731-bcc2-b0882f10299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:09.181270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf670-9964-4731-bcc2-b0882f10299a admin admin] PATH_INFO: `/v3/roles` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:09.181988 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baf670-9964-4731-bcc2-b0882f10299a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:09.183598 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baf670-9964-4731-bcc2-b0882f10299a admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:09.194043 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1445/2880] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:59:09.197979 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8923b-fec3-49ad-ac0b-64dd065a311d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:09.208202 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8923b-fec3-49ad-ac0b-64dd065a311d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:09.213151 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20459f31-40c2-4aab-8d7b-a5cf0bac5afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:09.213799 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459f31-40c2-4aab-8d7b-a5cf0bac5afe admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:09.214126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459f31-40c2-4aab-8d7b-a5cf0bac5afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:09.214406 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20459f31-40c2-4aab-8d7b-a5cf0bac5afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:09.215138 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20459f31-40c2-4aab-8d7b-a5cf0bac5afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:09.216747 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20459f31-40c2-4aab-8d7b-a5cf0bac5afe admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:09.228604 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1436/2881] 10.222.0.70 () {58 vars in 1121 bytes} [Wed May 18 22:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 22:59:09.232802 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf670-9964-4731-bcc2-b0882f10299a admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:09.243227 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf670-9964-4731-bcc2-b0882f10299a admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:09.247877 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:09.248789 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:09.249073 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:09.249349 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] PATH_INFO: `/v3/projects/c72b46eaec154d6688601d82e7d1a1e7/users/4e80dc5a9ddd4cd1a689d11214abf922/roles/a080c6e46ea94d0792cb2cb7c51b4f65` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:09.263843 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72b46eaec154d6688601d82e7d1a1e7, user_id=4e80dc5a9ddd4cd1a689d11214abf922, role_id=a080c6e46ea94d0792cb2cb7c51b4f65)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:09.266523 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:09.337220 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1446/2882] 10.222.0.70 () {60 vars in 1482 bytes} [Wed May 18 22:59:09 2022] PUT /identity/v3/projects/c72b46eaec154d6688601d82e7d1a1e7/users/4e80dc5a9ddd4cd1a689d11214abf922/roles/a080c6e46ea94d0792cb2cb7c51b4f65 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:59:09.347257 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0876-7c50-4cba-afc4-766b729f1493 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:09.347553 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0876-7c50-4cba-afc4-766b729f1493 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:09.347888 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d0876-7c50-4cba-afc4-766b729f1493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:09.375236 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-049d0876-7c50-4cba-afc4-766b729f1493 None None] MFA Rules not processed for user `4e80dc5a9ddd4cd1a689d11214abf922`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:59:09.381022 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-049d0876-7c50-4cba-afc4-766b729f1493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:59:09.440739 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1437/2883] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:59:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:59:09.451175 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:09.452922 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:59:09.467427 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:09.510637 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc9f01-8566-4710-a0e9-4705509120d1 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:09.514363 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5a8e8-8c17-4717-9023-72ee6f6a4b74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe4941cd1afb4318b42263390025d198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:09.514992 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5a8e8-8c17-4717-9023-72ee6f6a4b74 service cinder] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:09.515270 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5a8e8-8c17-4717-9023-72ee6f6a4b74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:09.515538 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5a8e8-8c17-4717-9023-72ee6f6a4b74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:09.524401 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5a8e8-8c17-4717-9023-72ee6f6a4b74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:09.525912 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5a8e8-8c17-4717-9023-72ee6f6a4b74 service cinder] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:09.535074 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1447/2884] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:59:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:59:19.437592 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:19.560724 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=20 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:20.766126 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d0876-7c50-4cba-afc4-766b729f1493 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:20.828839 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d0876-7c50-4cba-afc4-766b729f1493 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:20.833407 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:20.834312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:20.834594 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:20.834868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] PATH_INFO: `/v3/users/4e80dc5a9ddd4cd1a689d11214abf922` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:20.836146 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e80dc5a9ddd4cd1a689d11214abf922)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:20.838097 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:21.041735 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e80dc5a9ddd4cd1a689d11214abf922'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.113608 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e80dc5a9ddd4cd1a689d11214abf922'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.121885 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e80dc5a9ddd4cd1a689d11214abf922'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.122547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e80dc5a9ddd4cd1a689d11214abf922'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.134763 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e80dc5a9ddd4cd1a689d11214abf922'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.140663 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1438/2885] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 22:59:20 2022] DELETE /identity/v3/users/4e80dc5a9ddd4cd1a689d11214abf922 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:59:21.145382 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4510-3491-409c-9bda-beb34ff07b45 None None] REQUEST_METHOD: `POST` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:21.145870 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4510-3491-409c-9bda-beb34ff07b45 None None] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:21.145979 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc4510-3491-409c-9bda-beb34ff07b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:21.162878 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.auth.core [None req-3dcc4510-3491-409c-9bda-beb34ff07b45 None None] MFA Rules not processed for user `45cbea53fb4d428dbebc3700d01065fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80364) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 22:59:21.164090 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3dcc4510-3491-409c-9bda-beb34ff07b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:59:21.221863 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1448/2886] 10.222.0.70 () {58 vars in 957 bytes} [Wed May 18 22:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 22:59:21.235547 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:21.236935 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:59:21.294559 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe6c29-3024-4267-a987-f2c479824a5b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:21.298125 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ab665-a5b1-479c-b3f1-c777024dfb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47783bb7d4cc41c6ac4c1adb682b093b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:21.298760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ab665-a5b1-479c-b3f1-c777024dfb6d service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:21.299043 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ab665-a5b1-479c-b3f1-c777024dfb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:21.299318 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ab665-a5b1-479c-b3f1-c777024dfb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:21.308524 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ab665-a5b1-479c-b3f1-c777024dfb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:21.309940 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ab665-a5b1-479c-b3f1-c777024dfb6d service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:21.319324 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1439/2887] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 22:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 22:59:21.710630 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4510-3491-409c-9bda-beb34ff07b45 None None] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 22:59:21.712796 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-3dcc4510-3491-409c-9bda-beb34ff07b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 22:59:21.724754 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc4510-3491-409c-9bda-beb34ff07b45 None None] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 22:59:21.729784 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 22:59:21.730662 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 22:59:21.730937 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 22:59:21.731204 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] PATH_INFO: `/v3/projects/c72b46eaec154d6688601d82e7d1a1e7` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 22:59:21.732370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72b46eaec154d6688601d82e7d1a1e7)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 22:59:21.734322 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 22:59:21.841100 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72b46eaec154d6688601d82e7d1a1e7', 'request_id': 'req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.890122 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72b46eaec154d6688601d82e7d1a1e7', 'request_id': 'req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.896120 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72b46eaec154d6688601d82e7d1a1e7', 'request_id': 'req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.908391 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] The token cache is being invalidate because project c72b46eaec154d6688601d82e7d1a1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 22:59:21.908699 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.909327 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 22:59:21.910951 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1449/2888] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 22:59:21 2022] DELETE /identity/v3/projects/c72b46eaec154d6688601d82e7d1a1e7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 22:59:31.315312 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:31.905320 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:29.036756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4cb6-4b98-412b-b8c9-3614a0567409 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 23:00:29.036756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4cb6-4b98-412b-b8c9-3614a0567409 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 23:00:29.036756 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b4cb6-4b98-412b-b8c9-3614a0567409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 23:00:29.052070 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-661b4cb6-4b98-412b-b8c9-3614a0567409 None None] MFA Rules not processed for user `39cd155a775f496ea9dd309eb3c47af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 23:00:29.053273 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-661b4cb6-4b98-412b-b8c9-3614a0567409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 23:00:29.108266 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1440/2889] 10.222.0.70 () {58 vars in 967 bytes} [Wed May 18 23:00:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 23:00:29.243307 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 23:00:29.244723 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 23:00:29.313521 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df334fff-ddf2-48bf-8ea1-5ed1171f3bf7 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 23:00:29.318564 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a1b5-58ea-4ef3-9c45-edb1fd7adef1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c90d79a9665b4d9f8dc1ea440882a65c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 23:00:29.319202 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a1b5-58ea-4ef3-9c45-edb1fd7adef1 service swift] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 23:00:29.319479 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a1b5-58ea-4ef3-9c45-edb1fd7adef1 service swift] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 23:00:29.319750 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92a1b5-58ea-4ef3-9c45-edb1fd7adef1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 23:00:29.327866 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92a1b5-58ea-4ef3-9c45-edb1fd7adef1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 23:00:29.329446 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92a1b5-58ea-4ef3-9c45-edb1fd7adef1 service swift] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 23:00:29.337984 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1450/2890] 10.222.0.70 () {60 vars in 1384 bytes} [Wed May 18 23:00:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 23:00:37.593499 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4cb6-4b98-412b-b8c9-3614a0567409 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 23:00:37.595101 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-661b4cb6-4b98-412b-b8c9-3614a0567409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 23:00:37.662864 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b4cb6-4b98-412b-b8c9-3614a0567409 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 23:00:37.667529 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 23:00:37.668403 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 23:00:37.668685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 23:00:37.668959 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] PATH_INFO: `/v3/users/9360bc198e484dd0bdcd9239f4510b0a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 23:00:37.670200 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9360bc198e484dd0bdcd9239f4510b0a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 23:00:37.672119 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 23:00:37.818695 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9360bc198e484dd0bdcd9239f4510b0a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:37.867819 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9360bc198e484dd0bdcd9239f4510b0a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:37.875008 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9360bc198e484dd0bdcd9239f4510b0a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:37.875649 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9360bc198e484dd0bdcd9239f4510b0a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:37.888382 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9360bc198e484dd0bdcd9239f4510b0a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:37.895187 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1441/2891] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 23:00:37 2022] DELETE /identity/v3/users/9360bc198e484dd0bdcd9239f4510b0a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 23:00:38.160755 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a1b5-58ea-4ef3-9c45-edb1fd7adef1 service swift] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 23:00:38.173730 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92a1b5-58ea-4ef3-9c45-edb1fd7adef1 service swift] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 23:00:38.232510 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 23:00:38.233289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 23:00:38.233593 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 23:00:38.233865 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] PATH_INFO: `/v3/projects/d6448a906a594b6183ad55b7c49b24ff` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 23:00:38.235089 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6448a906a594b6183ad55b7c49b24ff)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 23:00:38.236968 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 23:00:38.352697 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6448a906a594b6183ad55b7c49b24ff', 'request_id': 'req-83fd64d6-3ffa-428b-9bab-d211ebc48622'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.444545 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6448a906a594b6183ad55b7c49b24ff', 'request_id': 'req-83fd64d6-3ffa-428b-9bab-d211ebc48622'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.450647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6448a906a594b6183ad55b7c49b24ff', 'request_id': 'req-83fd64d6-3ffa-428b-9bab-d211ebc48622'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.461867 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] The token cache is being invalidate because project d6448a906a594b6183ad55b7c49b24ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 23:00:38.462182 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.462805 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.464374 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1451/2892] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 23:00:38 2022] DELETE /identity/v3/projects/d6448a906a594b6183ad55b7c49b24ff => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 23:00:38.468452 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 23:00:38.469953 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 23:00:38.483495 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c17cf-37dc-4bf1-a4ee-1fb1772b9b32 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 23:00:38.504339 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:38.541591 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 23:00:38.542480 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 23:00:38.542760 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 23:00:38.543029 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] PATH_INFO: `/v3/users/13095991810c4229931ea77abfc3cd52` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 23:00:38.544182 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=13095991810c4229931ea77abfc3cd52)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 23:00:38.546131 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 23:00:38.725612 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13095991810c4229931ea77abfc3cd52'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.792350 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13095991810c4229931ea77abfc3cd52'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.803170 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13095991810c4229931ea77abfc3cd52'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.803887 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13095991810c4229931ea77abfc3cd52'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.820578 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13095991810c4229931ea77abfc3cd52'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:38.830086 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1442/2893] 10.222.0.70 () {58 vars in 1223 bytes} [Wed May 18 23:00:38 2022] DELETE /identity/v3/users/13095991810c4229931ea77abfc3cd52 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 23:00:39.067924 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 23:00:39.069343 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 23:00:39.084491 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd64d6-3ffa-428b-9bab-d211ebc48622 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 23:00:39.102201 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:39.140906 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cbea53fb4d428dbebc3700d01065fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c35a2b52a5945feba11f71adc84e226', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 23:00:39.141768 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 23:00:39.142091 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 23:00:39.142370 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] PATH_INFO: `/v3/projects/aaa42dd66f804bda843aaea13937dcaf` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 23:00:39.144072 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa42dd66f804bda843aaea13937dcaf)` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 23:00:39.146133 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 23:00:39.237556 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa42dd66f804bda843aaea13937dcaf', 'request_id': 'req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:39.290622 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa42dd66f804bda843aaea13937dcaf', 'request_id': 'req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:39.296302 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa42dd66f804bda843aaea13937dcaf', 'request_id': 'req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819'} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:39.307649 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] The token cache is being invalidate because project aaa42dd66f804bda843aaea13937dcaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80364) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 23:00:39.307934 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:39.308635 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.notifications [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80364) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 23:00:39.310289 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1452/2894] 10.222.0.70 () {58 vars in 1232 bytes} [Wed May 18 23:00:39 2022] DELETE /identity/v3/projects/aaa42dd66f804bda843aaea13937dcaf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 23:00:47.815252 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 23:00:47.817313 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 23:00:47.886171 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe731-d16b-4325-8f4c-990bbcb23bcd admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 23:00:47.929720 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:47.946625 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d7ac0-f01a-448a-8655-d7c708778554 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 23:00:47.947281 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7ac0-f01a-448a-8655-d7c708778554 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 23:00:47.947568 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7ac0-f01a-448a-8655-d7c708778554 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 23:00:47.947868 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d7ac0-f01a-448a-8655-d7c708778554 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 23:00:47.949685 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ac3d7ac0-f01a-448a-8655-d7c708778554 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 23:00:47.961031 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d7ac0-f01a-448a-8655-d7c708778554 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 23:00:47.962684 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d7ac0-f01a-448a-8655-d7c708778554 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 23:00:47.973021 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1443/2895] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 23:00:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 23:00:49.304652 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:58.204856 dv-cinder-838009-6-iscsi devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=11 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:05:52.858207 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] Authenticating user token {{(pid=80364) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 23:05:52.859603 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.fernet_utils [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80364) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 23:05:52.945489 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3e7ef-b5fa-4ff4-baf7-3ca649951819 admin admin] Validating token access rules against request {{(pid=80364) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 23:05:52.950647 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7898dc3-dac9-4ece-8b44-b40a0a43db0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e234faadf42946058f41bd8e7b43408a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af0e8152e18c4e6a9f392bddbbfbc166', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80364) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 23:05:52.951314 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898dc3-dac9-4ece-8b44-b40a0a43db0f service placement] REQUEST_METHOD: `GET` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 23:05:52.951596 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898dc3-dac9-4ece-8b44-b40a0a43db0f service placement] SCRIPT_NAME: `/identity` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 23:05:52.951871 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898dc3-dac9-4ece-8b44-b40a0a43db0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80364) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 23:05:52.961148 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7898dc3-dac9-4ece-8b44-b40a0a43db0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 23:05:52.962770 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7898dc3-dac9-4ece-8b44-b40a0a43db0f service placement] RBAC: Authorization granted {{(pid=80364) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 23:05:52.972949 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: [pid: 80364|app: 0|req: 1453/2896] 10.222.0.70 () {60 vars in 1365 bytes} [Wed May 18 23:05:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 23:06:02.968417 dv-cinder-838009-6-iscsi devstack@keystone.service[80364]: DEBUG dbcounter [-] [80364] Writing DB stats keystone:SELECT=37 {{(pid=80364) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}